Method and apparatus for transmitting digital broadcasting stream using linking information about multi-view video stream, and method and apparatus for receiving the same

ABSTRACT

A digital broadcasting stream transmitting method and a digital broadcasting stream receiving method and apparatus for providing three-dimensional (3D) video services are provided. The transmitting method including: generating a plurality of elementary streams (ESs) for a plurality of pieces of video information including at least one of information about a base-view video of a 3D video, information about an additional-view video corresponding to the base-view video, and a two-dimensional (2D) video having a different view from views of the 3D video; multiplexing the plurality of ESs with link information for identifying at least one piece of video information linked with the plurality of pieces of video information, to generate at least one transport stream (TS); and transmitting the generated at least one TS via at least one channel.

CROSS-REFERENCE TO RELATED PATENT APPLICATIONS

This application claims the benefit of U.S. Provisional PatentApplication No. 61/299,121, filed on Jan. 28, 2010 in the U.S. Patentand Trademark Office, and priority from Korean Patent Application No.10-2010-0044056, filed on May 11, 2010 in the Korean IntellectualProperty Office, the disclosures of which are incorporated herein intheir entireties by reference.

BACKGROUND

1. Field

Apparatuses and methods consistent with exemplary embodiments relate todigital data transmitting and receiving for providing two-dimensional(2D) contents or three-dimensional (3D) contents.

2. Description of the Related Art

In a Moving Picture Experts Group (MPEG) Transport (TS) based digitalbroadcasting method, a transmission terminal inserts uncompressed videodata and an uncompressed audio stream into respective elementary streams(ESs), multiplexes each of the ESs to generate a TS, and transmits theTS via a channel.

The TS includes program specification information (PSI) together withthe ESs. The PSI representatively includes a program association table(hereinafter, referred to as PAT information) and a program map table(hereinafter, referred to as PMT information). PMT information providingsingle-program information describes a Packet Identifier (PID) for eachES, and PAT information describes a PID for each PMT information.

A reception terminal receives a TS via a channel and extracts an ES fromthe TS through a process reverse to the process performed in atransmission terminal. Digital contents contained in the ES is restoredand reproduced by a display device.

SUMMARY

According to an aspect of an exemplary embodiment, there is provided adigital broadcasting stream transmitting method for providing 3D videoservices, the method including: generating a plurality of ESs for aplurality of pieces of video information including at least one ofinformation about a base-view video of a 3D video, information about anadditional-view video corresponding to the base-view video, and a 2Dvideo having a different view from views of the 3D video; generating atleast one TS by multiplexing the plurality of ESs with link informationfor identifying at least one piece of video information linked with eachof the plurality of pieces of video information; and transmitting thegenerated at least one TS via at least one channel.

The generating the at least one TS may include multiplexing each of theESs to generate at least one TS, and the transmitting the at least oneTS may include transmitting the at least one multi-program transportstream via different channels.

The generating the at least one TS may include multiplexing each of theESs to generate at least one TS, and the transmitting the least one TSmay include transmitting the at least one TS via a single channel.

The generating the at least one TS may include multiplexing the ESs togenerate a single TS, and the transmitting the least one TS may includetransmitting the single TS via a single channel.

According to an aspect of another exemplary embodiment, there isprovided a digital broadcasting stream receiving method for providing 3Dvideo services, the method including: receiving at least one TS for aplurality of pieces of video information including at least one ofinformation about a base-view video of a 3D video, information about anadditional-view video of the 3D video, and a 2D video having a differentview from views of the 3D video, via at least one channel;demultiplexing the received at least one TS to extract, from the atleast one TS, linking information for identifying at least one piece ofvideo information linked with the plurality of pieces of videoinformation and at least one ES for the plurality of pieces of videoinformation; and decoding the extracted at least one ES to reproduce atleast one of the 3D video and the 2D video restored by the decodingbased on the linking information.

The receiving may include receiving a plurality of TS by decoding eachof the at least one channel and receiving a single TS from each of theat least one channel, and the extracting may include extracting at leastone ES by demultiplexing each of the at least one multi-program TS.

The receiving may include receiving a plurality of TSs via a channelfrom among the at least one channel by decoding the channel, and theextracting may include extracting the at least one ES by demultiplexingeach of the at least one TS.

The receiving may include receiving a TS of a channel from among the atleast one channel by decoding the channel, and the extracting mayinclude extracting the at least one ES by demultiplexing the transportstream.

The linking information may include a link identifier that representswhether mutually linked pieces of video information exist in theplurality of pieces of video information included in the at least oneTS, and a link descriptor that includes information about a link betweenmutually linked pieces of video information from among the plurality ofpieces of video information included in the at least one TS.

The link identifier may be included in a program association table forthe at least one TS.

The link descriptor may be included in a program map table for the ESsfor the mutually linked pieces of video information.

A 3D video stream descriptor including additional information used toreproduce current video information of a current TS may be included in aprogram map table for the current video information.

According to an aspect of another exemplary embodiment, there isprovided a digital broadcasting stream transmitting apparatus forproviding 3D video services, the apparatus including: an ES generationunit which generates a plurality of ESs for a plurality of pieces ofvideo information including at least one of information about abase-view video of a 3D video, information about an additional-viewvideo corresponding to the base-view video, and a 2D video having adifferent view from views of the 3D video; a TS generation unit whichgenerates at least one TS by multiplexing the generated plurality of ESswith link information for identifying at least one piece of videoinformation linked with the plurality of pieces of video information;and a transmission unit which transmits the at least one TS via at leastone channel.

According to an aspect of another exemplary embodiment, there isprovided a digital broadcasting stream receiving apparatus for providing3D video services, the apparatus including: a TS receiving unit whichreceives at least one TS for a plurality of pieces of video informationincluding at least one of information about a base-view video of a 3Dvideo, information about an additional-view video of the 3D video, and a2D video having a different view from views of the 3D video, via atleast one channel; an ES extraction unit which demultiplexes thereceived at least one TS to extract, from the at least one TS, linkinginformation for identifying at least one piece of video informationlinked with the plurality of pieces of video information and at leastone ES for the plurality of pieces of video information; and areproduction unit which reproduces at least one of the 3D video data and2D video data restored by decoding the extracted at least one ES basedon a link represented by the linking information.

According to an aspect of another exemplary embodiment, there isprovided a computer-readable recording medium having recorded thereon aprogram for the above-described digital broadcasting stream transmittingmethod for providing 3D video services.

According to an aspect of another exemplary embodiment, there isprovided a computer-readable recording medium having recorded thereon aprogram for the above-described digital broadcasting stream receivingmethod for providing 3D video services.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects will become more apparent by describingin detail exemplary embodiments with reference to the attached drawingsin which:

FIG. 1 is a block diagram of a digital broadcasting stream transmittingapparatus according to an exemplary embodiment;

FIG. 2 is a block diagram of a digital broadcasting stream receivingapparatus according to an exemplary embodiment;

FIG. 3 is a block diagram of a digital TV transmitting system for 2Dcontents services according to an exemplary embodiment;

FIG. 4 is a block diagram of a digital TV receiving system for 2Dcontents services according to an exemplary embodiment;

FIG. 5 illustrates an example of a distribution of a channel frequencyband in which a plurality of video streams are transmitted and receivedvia a plurality of channels, according to a first exemplary embodiment;

FIG. 6 is a block diagram of a digital broadcasting stream transmittingapparatus that transmits a 3D video stream including linking informationvia a plurality of channels according to the first exemplary embodimentillustrated in FIG. 5;

FIG. 7 illustrates an example of a distribution of a channel frequencyband in which a plurality of TSs for a 3D video stream and a 2D videostream can be transmitted and received via a single channel, accordingto a second exemplary embodiment;

FIG. 8 is a block diagram of a digital broadcasting stream transmittingapparatus that transmits a plurality of TSs having linking informationvia a single channel according to the second exemplary embodimentillustrated in FIG. 7;

FIG. 9 is a block diagram of a digital broadcasting stream transmittingapparatus that transmits a single TS including a 3D video stream and a2D video stream via a single channel according to a third exemplaryembodiment;

FIG. 10 is a block diagram of a digital broadcasting stream receivingapparatus that receives a plurality of TSs via a plurality of channelscorresponding to a plurality of transmission network systems accordingto a fourth exemplary embodiment;

FIG. 11 illustrates an example of a distribution of a channel frequencyband in which a plurality of TSs for a base-view video stream of a 3Dvideo can be transmitted and received via a plurality of channels and inwhich a single TS for an additional-view video stream for the 3D videocan be transmitted and received via a single channel, according to afifth exemplary embodiment;

FIG. 12 illustrates an example of a distribution of a channel frequencyband in which a plurality of TSs for a multi-view video stream can betransmitted and received via a single channel, according to an exemplaryembodiment;

FIG. 13 illustrates an example in which down-scaling method informationfor 3D composite formats is used, according to an exemplary embodiment;

FIGS. 14, 15, 16, 17, and 18 are schematic views of reproduction unitsof a digital broadcasting stream receiving apparatus according toexemplary embodiments;

FIG. 19 is a flowchart of a digital broadcasting stream transmittingmethod capable of providing 3D video services, according to an exemplaryembodiment; and

FIG. 20 is a flowchart of a digital broadcasting stream receiving methodcapable of providing 3D video services, according to an exemplaryembodiment.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Hereinafter, exemplary embodiments will be described more fully withreference to the accompanying drawings. It is understood thatexpressions such as “at least one of,” when preceding a list ofelements, modify the entire list of elements and do not modify theindividual elements of the list. Further, a “unit” as used herein may beembodied as a hardware component and/or a software component that isexecuted by a computer or a hardware processor.

A digital broadcasting stream transmitting apparatus and method capableof providing 3D video services and a digital broadcasting streamreceiving apparatus and method capable of providing 3D video servicesaccording to exemplary embodiments will now be described in detail withreference to FIGS. 1 through 20.

FIG. 1 is a block diagram of a digital broadcasting stream transmittingapparatus 100 according to an exemplary embodiment.

Referring to FIG. 1, the digital broadcasting stream transmittingapparatus 100 includes an elementary stream (ES) generation unit 110, atransport stream (TS) generation unit 120, and a transmission unit 130.

The ES generation unit 110 generates a plurality of ESs for a pluralityof pieces of video information including at least one of informationabout a base-view video of a 3D video, information about anadditional-view video of the 3D video, and a two-dimensional (2D) video.

A single ES may be generated for a single piece of video information.The 3D video may be a combination of a single base-view video and asingle additional-view video corresponding to the single base-viewvideo, such as a stereo video, or a combination of a single base-viewvideo and a plurality of additional-view videos corresponding to thesingle base-view video.

The information about the additional-view video represents anadditional-view video corresponding to a base-view video, and thus maybe additional-view video data itself or at least one of depthinformation, disparity information, and the like relative to thebase-view video data.

The 2D video may not be a one-view video of the 3D video but a 2D videohaving a view separate from the views of the 3D video.

The TS generation unit 120 receives the plurality of ESs generated bythe ES generation unit 110. The TS generation unit 120 multiplexeslinking information between the plurality of pieces of video informationwith the plurality of ESs to generate at least one TS for the pluralityof ESs. The transmission unit 130 transmits the at least one TS via atleast one channel.

The linking information includes identifiers for indicating at least onevideo information piece associated with each of the plurality of videoinformation pieces.

The TS generation unit 120 may generate at least one TS by multiplexingeach of the plurality of ESs, and the transmission unit 130 may transmitthe at least one TS via different channels.

The TS generation unit 120 may generate at least one TS by individuallymultiplexing the plurality of ESs, and the transmission unit 130 maytransmit the at least one TS via a single channel.

The TS generation unit 120 may generate a single TS by multiplexing theplurality of ESs, and the transmission unit 130 may transmit the singleTS via a single channel.

An operation of the TS generation unit 120 will now be described indetail.

The TS generation unit 120 may packetize the ESs individually togenerate packetized elementary stream (PES) packets, and multiplex aprogram map table (hereinafter, referred to as PMT information)including the PES packets and linking information so as to generate asingle-program transport stream (SP TS). The TS generation unit 120 maygenerate an SP TS by multiplexing a video ES, an audio ES, additionaldata, and the like. The PMT information may be generated for each SP.

The TS generation unit 120 may generate a multi-program transport stream(MP TS) by multiplexing at least one SP TS with a program associationtable (hereinafter, referred to as PAT information).

In this case, a plurality of MP TSs not greater than the total number ofSP TSs may be generated by multiplexing the SP TSs into several groups.

First through fifth exemplary embodiments in which the TS generationunit 120 and the transmission unit 130 transmit a plurality of pieces ofvideo information via different ESs, different TSs, or differentchannels will now be described.

According to the first exemplary embodiment, the TS generation unit 120may generate at least one SP TS by multiplexing at least one ESindividually, and generate at least one MP TS by multiplexing the atleast one SP TS individually. According to the first exemplaryembodiment, the transmission unit 130 may transmit the at least one MPTS generated by the TS generation unit 120 according to the firstexemplary embodiment via channels based on the same transmission networksystem, respectively.

According to the second exemplary embodiment, the TS generation unit 120may generate at least one SP TS by multiplexing at least one ESindividually, and generate a single MP TS by multiplexing the at leastone SP TS together. According to the second exemplary embodiment, thetransmission unit 130 may transmit the single MP TS generated by the TSgeneration unit 120 according to the second exemplary embodiment via asingle channel.

According to the third exemplary embodiment, the TS generation unit 120may generate a single SP TS by multiplexing at least one ES together,and generate a single MP TS by multiplexing the single SP TS. Accordingto the third embodiment, the transmission unit 130 may transmit thesingle MP TS generated by the TS generation unit 120 according to thethird exemplary embodiment via a single channel.

According to the fourth exemplary embodiment, the TS generation unit 120may generate at least one SP TS and at least one MP TS from at least oneES as in the first exemplary embodiment. However, in contrast with thefirst exemplary embodiment, the transmission unit 130 according to thefourth exemplary embodiment may transmit the at least one MP TS viachannels based on individual kinds of transmission network systems,respectively.

According to the fifth exemplary embodiment, the TS generation unit 120may individually multiplex an ES for at least one base-view video fromamong at least one ES to generate at least one SP TS for the at leastone base-view video. According to the fifth exemplary embodiment, the TSgeneration unit 120 may individually multiplex the at least one SP TSfor the at least one base-view video to generate at least one base-viewMP TS.

In addition, according to the fifth exemplary embodiment, the TSgeneration unit 120 may individually multiplex an ES for at least oneadditional-view video corresponding to the at least one base-view videoto generate at least one SP TS for the at least one additional-viewvideo. According to the fifth exemplary embodiment, the TS generationunit 120 may multiplex the at least one SP TS for the at least oneadditional-view video together to generate a single additional-view MPTS.

According to the fifth exemplary embodiment, the transmission unit 130may transmit the at least one base-view MP TS and the singleadditional-view MP TS generated by the TS generation unit 120 accordingto the fifth exemplary embodiment via different channels, respectively.

Referring back to FIG. 1, the TS generation unit 120 may include linkinginformation between a plurality of pieces of video information in the atleast one TS by inserting the linking information into programspecification information (PSI).

The linking information may be classified into a link identifier and alink descriptor.

The link identifier indicates whether associated pieces of videoinformation exist in the plurality of pieces of video informationincluded in the at least one TS. The TS generation unit 120 may includethe link identifier in the PAT information about the at least one TS. Inthis case, the link identifier may indicate whether pieces of PMTinformation identified by the PAT information are linked to each other.

The link descriptor may include information about a link between theassociated pieces of video information existing in the plurality ofpieces of video information included in the at least one TS. The TSgeneration unit 120 may insert the link descriptor into a descriptorregion of the PMT information.

The TS generation unit 120 may insert not only the linking informationbut also a 3D video authentication descriptor for representing whether acurrent ES is for a 3D video, into the PMT information. For example, atleast one of a 3D video start descriptor including 3D video informationstart information representing a location where additional informationabout the 3D video starts to be inserted, and a 3D video registrationdescriptor including format identifier information of the 3D video maybe inserted into PMT information about the current ES.

The link identifier will be described in greater detail below withreference to Table 1, the link descriptor will be described in greaterdetail below with reference to Tables 4, 5, and 6, and the 3D videoauthentication descriptor will be described in greater detail below withreference to Tables 2 and 3.

The TS generation unit 120 may insert not only the linking informationbut also a 3D video stream descriptor including additional informationused for reproducing current video information of a current TS, into PMTinformation for the current video information.

The 3D video stream descriptor may include information about conversionof a 2D/3D reproduction mode that occurs on a current video stream.

The 3D video stream descriptor may include information about the viewsof a 3D video used to set view information individually, for example,for children and adults.

The 3D video stream descriptor will be described in greater detail belowwith reference to Tables 7 through 16.

Accordingly, the digital broadcasting stream transmitting apparatus 100of FIG. 1 may insert 3D video information into different channels,different TSs, or different ESs to transmit the 3D video information. Asfor associated pieces of video information, linking information foridentifying locations into which their opponent pieces of videoinformation have been inserted may be set. The linking information maybe inserted into PMT information of TSs for the associated videoinformation pieces and transmitted.

FIG. 2 is a block diagram of a digital broadcasting stream receivingapparatus 200 according to an exemplary embodiment.

Referring to FIG. 2, the digital broadcasting stream receiving apparatus200 includes a TS receiving unit 210, an ES extraction unit 220, and areproduction unit 230.

The TS receiving unit 210 receives at least one TS including a pluralityof pieces of video information via at least one channel. The received atleast one TS may include at least one of information about a base-viewvideo of a 3D video, information about an additional-view videocorresponding to the base-view video, and a 2D video. The 2D video maybe video information of a view different from the views of the 3D video.The information about the additional-view video corresponding to thebase-view video may be additional-view video data itself or may be atleast one of disparity information and depth information that allows theadditional-view video data to be restored based on the base-view videodata.

The ES extraction unit 220 receives the at least one TS from the TSreceiving unit 210 and demultiplexes the TS to extract at least one ESfor the plurality of video information pieces from the TS. The ESextraction unit 220 also extracts linking information between videoinformation pieces from the demultiplexed TS.

The TS receiving unit 210 may receive an MP TS via at least one channel.A single MP TS may be received via each channel.

The TS receiving unit 210 may receive a plurality of TSs by individuallydecoding a plurality of channels and receiving a single TS from each ofthe channels. The ES extraction unit 220 may extract a plurality of ESsby demultiplexing a plurality of MP TSs individually.

The TS receiving unit 210 may receive a plurality of TSs by decoding asingle channel, and the ES extraction unit 220 may extract a pluralityof ESs by demultiplexing the plurality of TSs.

The TS receiving unit 210 may receive a single TS by decoding a singlechannel, and the ES extraction unit 220 may extract a plurality of ESsby demultiplexing the single TS.

An operation of the ES extraction unit 220 will now be described ingreater detail.

The ES extraction unit 220 may demultiplex an MP TS to extract at leastone SP TS together with PAT information from the demultiplexed MP TS.The ES extraction unit 220 may demultiplex each SP TS to extract PESpackets and PMT information.

The PMT information may include linking information about a link betweena plurality of ESs included in the at least one SP TS. The PES packetsmay be depacketized into the ESs.

Each ES may include base-view video information for a 3D video,additional-view video information for the 3D video, a 3D compositeformat of the base-view video information and the additional-view videoinformation, or 2D video information. The ES extraction unit 220 mayalso extract an audio ES from the demultiplexed SP TS.

Since a single MP TS may be demultiplexed into at least one SP TS, nofewer SP TSs than a plurality of MP TSs may be extracted.

The TS receiving unit 210 and the ES extraction unit 220 respectivelyreceive and demultiplex a TS generated and transmitted respectively bythe TS generation unit 120 and the transmission unit 130. Accordingly,operations of the TS receiving unit 210 and the ES extraction unit 220to receive the at least one TS and extract an ES from the TS accordingto the aforementioned first through fifth exemplary embodiments are asfollows.

According to the first exemplary embodiment, the TS receiving unit 210may receive at least one MP TS by decoding at least one channelindividually and receiving a single MP TS from each of the channels.According to the first exemplary embodiment, the ES extraction unit 220may demultiplex the at least one MP TS individually to extract a singleSP TS from each of the MP TSs, and demultiplex each of the SP TSs toextract a single ES from each of the SP TSs. Thus, the TS receiving unit210 and the ES extraction unit 220 according to the first exemplaryembodiment may finally extract ESs for 3D video information or 2D videoinformation from at least one TS received for at least one channel.

According to the second exemplary embodiment, the TS receiving unit 210may decode a single channel to extract a single MP TS. According to thesecond exemplary embodiment, the ES extraction unit 220 may demultiplexthe single MP TS to extract at least one SP TS, and demultiplex the atleast one SP TS individually to extract at least one ES. Thus, the TSreceiving unit 210 and the ES extraction unit 220 according to thesecond exemplary embodiment may extract at least one SP TS via a singlechannel and thus extract ESs for 3D video information or 2D videoinformation.

According to the third exemplary embodiment, the TS receiving unit 210may decode a single channel to extract a single MP TS. According to thethird exemplary embodiment, the ES extraction unit 220 may demultiplexthe single MP TS to extract a single SP TS, and demultiplex the singleSP TS to extract at least one ES. Accordingly, the TS receiving unit 210and the ES extraction unit 220 according to the third exemplaryembodiment may finally extract at least one ES including 3D videoinformation or 2D video information via a single channel.

According to the fourth exemplary embodiment, in contrast with the firstexemplary embodiment, the TS receiving unit 210 may individually decodechannels based on individual kinds of transmission network systems andreceive a single MP TS for each channel to thereby receive at least oneMP TS. According to the fourth exemplary embodiment, the ES extractionunit 220 may demultiplex the at least one MP TS individually to extracta single SP TS from each of the at least one MP TS, and demultiplex eachSP TS to extract a single ES from each of the SP TSs. Thus, the TSreceiving unit 210 and the ES extraction unit 220 according to thefourth exemplary embodiment may finally extract ESs for 3D videoinformation or 2D video information from TSs respectively received via aplurality of channels based on individual kinds of transmission networksystems.

According to the fifth exemplary embodiment, the TS receiving unit 210may decode a plurality of channels to receive at least one base-view MPTS for a 3D video from at least one of the plurality of channels andreceive a single additional-view MP TS for the 3D video from one of theplurality of channels.

According to the fifth exemplary embodiment, the ES extraction unit 220may demultiplex the at least one base-view MP TS individually to extractat least one base-view SP TS, and demultiplex the at least one base-viewSP TS individually to extract at least one base-view ES. According tothe fifth exemplary embodiment, the ES extraction unit 220 may alsodemultiplex the single additional-view MP TS to extract at least oneadditional-view SP TS, and demultiplex the at least one additional-viewSP TS individually to extract at least one additional-view ES.

Accordingly, the TS receiving unit 210 and the ES extraction unit 220according to the fifth exemplary embodiment may finally extract aplurality of ESs for 3D video information or 2D video information via aplurality of channels.

Referring back to FIG. 2, the linking information extracted from the ESextraction unit 220 includes an identifier for indicating at least onepiece of video information associated with each of a plurality of piecesof video information. The linking information may be used by thereproduction unit 230 to search for other video data corresponding topredetermined video data and reproduce the video data while maintaininga link therebetween.

The ES extraction unit 220 may extract linking information between aplurality of pieces of video information from PSI of a TS. The linkinginformation may include a link identifier and a link descriptor. The ESextraction unit 220 may extract the link identifier of the linkinginformation from PAT information of the TS. In this case, the linkidentifier may represent whether pieces of PMT information identified bythe PAT information are linked to each other. The ES extraction unit 220may extract the link descriptor of the linking information from adescriptor region of the PMT information.

The ES extraction unit 220 may extract not only the linking informationbut also a 3D video authentication descriptor from the PMT information.Whether 3D video information is included in a current ES may be checkedfrom at least one of a 3D video start descriptor and a 3D videoregistration descriptor extracted as the 3D authentication descriptor.

The link identifier will be described in greater detail below withreference to Table 1, the link descriptor will be described in greaterdetail below with reference to Tables 4, 5, and 6, and the 3D videoauthentication descriptor will be described in greater detail below withreference to Tables 2 and 3.

The ES extraction unit 220 may extract not only the linking informationbut also a 3D video stream descriptor from PMT information for currentvideo information. The ES extraction unit 220 may extract informationrelated to conversion of a 2D/3D reproduction mode that occurs on acurrent video stream, information related with the views of a 3D videoused to set view information individually, for example, for children andadults, and other information from the 3D video stream descriptor. The3D video stream descriptor will be described in greater detail belowwith reference to Tables 7 through 16.

The reproduction unit 230 decodes the at least one ES extracted by theES extraction unit 220 to restore 3D video data or 2D video data. Thereproduction unit 230 may reproduce at least one of the restored 3Dvideo data and the restored 2D video data in consideration of a linkrepresented by the linking information.

For example, if the reproduction unit 230 receives an ES for base-viewvideo information of a 3D video and an ES for additional-view videoinformation of the 3D video from the ES extraction unit 220, thereproduction unit 230 may restore base-view video data andadditional-view video data of the 3D video from the ESs. In particular,the reproduction unit 230 may search for and restore the base-view videodata and the additional-view video data based on the linkinginformation, and may convert and reproduce the base-view video data andthe additional-view video data in a 3D reproduction format that can bereproduced by a 3D display device.

If the reproduction unit 230 receives an ES for 2D video information andan ES for disparity information or depth information for additional-viewvideo from the ES extraction unit 220, the reproduction unit 230 mayrestore the base-view video data and additional-view video data of the3D video from the ESs. In particular, the reproduction unit 230 maysearch for disparity information or depth information corresponding to2D video data based on the linking information to restore theadditional-view video data, and may convert and reproduce theadditional-view video data into a 3D reproduction format that can bereproduced by a 3D display device.

In addition, an ES for a 3D video of a 3D composite format and an ES fora 2D video may be input to the reproduction unit 230. The reproductionunit 230 may restore video information of a 3D composite format into 3Dvideo data based on the linking information and may convert the 3D videodata into base-view video data and additional-view video data that mayboth be reproduced by a 3D display device. Since the reproduction unit230 may also restore 3D video data, the reproduction unit 230 mayselectively reproduce the base-view video data, the additional-viewvideo data, and the 2D video data.

If associated ESs for a 2D video are input to the reproduction unit 230,the reproduction unit 230 may restore corresponding items of 2D videodata based on the linking information and selectively and independentlyreproduce the 2D video data items. The reproduction unit 230 mayselectively reproduce the corresponding 2D video data items according tothe linking information in a Picture-in-Picture (PIP) mode.

The ES extraction unit 220 of the digital broadcasting stream receivingapparatus 200 may detect associated pieces of video informationtransmitted via different channels, different SP TSs, or different ESsby using the linking information to extract only associated ESs. Thereproduction unit 230 of the digital broadcasting stream receivingapparatus 200 may recognize the existence of different video streamsassociated with an SP video stream selected by a user according to thelinking information and may reproduce the associated video streams.

The digital broadcasting stream transmitting apparatus 100 and thedigital broadcasting stream receiving apparatus 200 may provide digitalcontents services of a 3D video and digital contents services of a 2Dvideo while maintaining compatibility with digital broadcasting systemsthat use Moving Picture Experts Group (MPEG) based TSs.

Since PMT information includes information about a single video ES, atransmission terminal inserts, into each PMT information, associationinformation for identifying an ES, a TS, or a channel in which opponentvideo information is located, and thus a reception terminal mayreproduce associated items video data according to the associationinformation between ESs, TSs, or channels in a 3D reproduction mode or a2D reproduction mode.

In addition, since not only linking information but also informationabout a conversion between a 2D video reproduction method and a 3D videoreproduction method and additional information about 3D videocharacteristics are transmitted and received via PMT information, thedigital broadcasting stream transmitting apparatus 100 and the digitalbroadcasting stream receiving apparatus 200 may smoothly provide digitalcontents services of 3D video while maintaining compatibility withdigital broadcasting systems for 2D contents services.

Without needing to newly generate PSI or a TS for the PSI, linkinginformation between a plurality of pieces of video information andadditional information such as a 3D video stream descriptor may beincluded in PMT information or PAT information. In addition, additionalinformation may be included in a reserved field without needing to add apacket identifier (PID) to the PMT information.

FIG. 3 is a block diagram of a digital TV transmitting system 300 for 2Dcontents services according to an exemplary embodiment.

Referring to FIG. 3, the digital TV transmitting system 300 generates anSP TS including a single video ES and a single audio ES by using asingle-program encoder 310 and multiplexes at least one SP TS generatedby a plurality of single-program encoders by using a multiplexer (MUX)380 to generate and transmit an MP TS.

The single-program encoder 310 includes a video encoder 320, an audioencoder 330, packetizers 340 and 350, and a multiplexer (MUX) 360.

The video encoder 320 and the audio encoder 330 encode uncompressedvideo data and uncompressed audio data, respectively, to generate andoutput a video ES and an audio ES, respectively. The packetizers 340 and350 of the single-program encoder 310 packetize the video ES and theaudio ES, respectively, and insert PES headers into the packetized videoES and the packetized audio ES, respectively, to generate a video PESpacket and an audio PES packet, respectively.

The MUX 360 multiplexes the video PES packet, the audio PES packet, anda variety of additional data to generate a first single-programtransport stream SP TS1. PMT information may be multiplexed with thevideo PES packet and the audio PES packet and included in the firstsingle-program transport stream SP TS1. PMT information is inserted intoeach single-program transport stream and describes a PID of each ES oradditional data.

The MUX 380 multiplexes a plurality of single-program transport streamsSP TS1, SP TS2, . . . with PAT information to generate a multi-programtransport stream MP TS.

The PMT information and the PAT information are generated by a PSI andProgram and System Information Protocol (PSIP) generator 370.

The multi-program transport stream (MP TS) may include the PATinformation and a PSIP. The PAT information describes PIDs of PMTinformation about single-program transport streams included in amulti-program transport stream.

FIG. 4 is a block diagram of a digital TV receiving system 400 for 2Dcontents services according to an exemplary embodiment.

The digital TV receiving system 400 receives a digital broadcastingstream and extracts video data, audio data, and additional data from thedigital broadcasting stream.

A digital TV (DTV) tuner 410 is tuned to a wave frequency of a channelselected according to a physical channel select signal input by a viewerto selectively extract a signal received via a wave corresponding to thewave frequency. A channel decoder and demodulator 420 extracts amulti-program transport stream MP TS from a channel signal. Themulti-program transport stream MP TS is demultiplexed into a pluralityof single-program transport streams SP TS1, SP TS2, . . . and a PSIP bya demultiplexer (DEMUX) 430.

A first single-program transport stream SP TS1 selected by a programselect signal input by a viewer is decoded by a single-program decoder440. The single-program decoder 440 operates reversely to thesingle-program encoder 310. A video PES packet, an audio PES packet, andadditional data are restored from the first single-program transportstream SP TS1. The video PES packet and the audio PES packet arerestored to ESs by depacketizers 460 and 465, respectively, and then theESs are restored to video data and audio data by a video decoder 470 andan audio decoder 475, respectively. The video data may be converted intoa displayable format by a display processor 480.

A clock recovery and audio/video (AV) synchronization device 490 maysynchronize a video data reproduction time with an audio datareproduction time by using program clock reference (PCR) information andtime stamp information extracted from the first single-program transportstream SP TS1.

A program guide database 445 may receive the program select signal inputby a viewer, search for a channel and a program corresponding to theprogram select signal input by the viewer by comparing the programselect signal with the PSIP extracted from the multi-program transportstream MP TS, and then transmit a channel selection input signal to thedigital TV tuner 410 and a program selection input signal to the DEMUX430. The program guide database 445 may also transmit on-screen displayinformation to the display processor 480 and support an on-screendisplay operation.

Various exemplary embodiments in which the digital broadcasting streamtransmitting apparatus 100 and the digital broadcasting stream receivingapparatus 200 transmit and receive 3D video information, linkinginformation, and 3D additional information through a plurality ofchannels or a plurality of ESs in order to provide a 3D digitalbroadcasting service while maintaining compatibility with an MPEGTS-based digital broadcasting systems for providing 2D contents serviceswill now be described with reference to FIGS. 5 through 11.

Hereinafter, a video stream may be a general term for video informationsuch as video data, disparity information, depth information, or thelike, and an ES, a PES packet, a single-program transport stream, and amulti-program transport stream that are results of conversions performedat different stages.

In the exemplary embodiments described below with reference to FIGS. 5through 11, a stereo video stream including a left view video and aright view video is transmitted and received for convenience ofexplanation. However, the digital broadcasting stream transmittingapparatus 100 and the digital broadcasting stream receiving apparatus200 may also be applied to multi-view video streams each including areference view and at least one additional view, as in an exemplaryembodiment of FIG. 12.

FIG. 5 illustrates an example of a distribution of a channel frequencyband 500 in which a plurality of video streams can be transmitted andreceived via a plurality of channels, according to the above-describedfirst exemplary embodiment.

In the channel frequency band 500, a frequency band is allocated to eachof the plurality of channels. For example, the channel frequency band500 includes a frequency band 510 for channel 6, a frequency band 520for channel 7, a frequency band 530 for channel 8, a frequency band 540for channel 9, and a frequency band 550 for channel 10.

A TS for left-view video information and a TS for right-view videoinformation may be transmitted and received as a first stereo videothrough the frequency band 510 for channel 6 and the frequency band 530for channel 8, respectively. In this case, linking informationindicating existence of an association between videos of a stereo video,namely, indicating that the videos are stereo linked, may be set forchannel 6 and channel 8. The linking information may be set betweenchannels, TSs, or ESs.

A TS for left-view video information and a TS for right-view videoinformation may be transmitted and received as a second stereo videothrough the frequency band 520 for channel 7 and the frequency band 550for channel 10, respectively. In this case, linking informationindicating existence of an association between videos of a stereo video,namely, indicating that the videos are stereo linked, may be set forchannel 7 and channel 10.

Accordingly, in a method of allocating a stereo video stream to channelsaccording to the first exemplary embodiment, a TS for a left-view videoand a TS for a right-view video are transmitted via different channels,respectively.

FIG. 6 is a block diagram of a digital broadcasting stream transmittingapparatus 600 that transmits a 3D video stream having linkinginformation via a plurality of channels according to the first exemplaryembodiment described above with reference to FIG. 5.

The digital broadcasting stream transmitting apparatus 600 correspondsto a block diagram of the digital broadcasting stream transmittingapparatus 100 that is constructed according to the first exemplaryembodiment of FIG. 5. Operations of single-program encoders 610, 630,and 650 and MUXes 620, 640, and 660 of the digital broadcasting streamtransmitting apparatus 600 correspond to operations of the ES generationunit 110 and the TS generation unit 120 of the digital broadcastingstream transmitting apparatus 100 that are performed according to thefirst exemplary embodiment. Operations of channel encoder and modulators625, 645, and 665 and a DTV transmitter 670 of the digital broadcastingstream transmitting apparatus 600 correspond to an operation of thetransmission unit 130 of the digital broadcasting stream transmittingapparatus 100 that is performed according to the first exemplaryembodiment.

The single-program encoders 610, 630, and 650 may receive a left-viewvideo sequence Left Seq., a 2D video sequence 2D Seq., and a right-viewvideo sequence Right Seq. to generate and output a first single-programtransport stream SP TS1, a second single-program transport stream SPTS2, and a third single-program transport stream SP TS3, respectively.

The first single-program transport stream SP TS1 for the left-view videosequence may be multiplexed by the MUX 620 to generate a firstmulti-program transport stream MP TS1. Similarly, the secondsingle-program transport stream SP TS2 for the 2D video sequence and thethird single-program transport stream SP TS3 for the right-view videosequence may be respectively multiplexed by the MUXes 640 and 660 torespectively generate a second multi-program transport stream MP TS2 anda third multi-program transport stream MP TS3.

The first multi-program transport stream MP TS1 may be encoded andmodulated according to channel 6 (or channel 7) by the channel encoderand modulator 625. The third multi-program transport stream MP TS3 maybe encoded and modulated according to channel 8 (or channel 10) by thechannel encoder and modulator 665. The second multi-program transportstream MP TS2 may be encoded and modulated according to channel 9 by thechannel encoder and modulator 645.

The DTV transmitter 670 may transmit a broadcasting video streamallocated to the plurality of channels. Thus, the digital broadcastingstream transmitting apparatus 600 and the digital broadcasting streamtransmitting apparatus 100 according to the first exemplary embodimentmay generate a single-program transport stream and a multi-programtransport stream from each of a left-view video and a right-view videoof a stereo video and a 2D video and transmit the single-programtransport streams and the multi-program transport streams via aplurality of channels, respectively.

The single program encoder 610 for the left-view video may set linkinginformation 615 for identifying the right-view video as corresponding tothe left-view video. The single program encoder 650 for the right-viewvideo may set linking Information 655 for identifying the left-viewvideo as corresponding to the right-view video. If a video associatedwith the 2D video exists, the single program encoder 630 for the 2Dvideo may set linking information 635 for identifying the associatedvideo. Each linking information may be inserted into PMT information ofa single-program transport stream.

According to the first exemplary embodiment, the digital broadcastingstream receiving apparatus 200 may selectively receive a TS for aleft-view video of a stereo video, a TS for a right-view video of thestereo video, and a TS for a 2D video transmitted via differentchannels, and restore video data of a desired TS.

According to the first exemplary embodiment, the ES extraction unit 220of the digital broadcasting stream receiving apparatus 200 may extractlinking information. The reproduction unit 230 according to the firstexemplary embodiment may identify a right-view video sequencecorresponding to a left-view video sequence by using the linkinginformation and thus perform 3D reproduction. The linking informationmay also be used by the ES extraction unit 220 when searching for athird single-program transport stream corresponding to a firstsingle-program transport stream to extract ESs from the first and thirdsingle-program transport streams, respectively.

FIG. 7 illustrates an example of a distribution of a channel frequencyband 700 in which a plurality of TSs for a 3D video stream and a 2Dvideo stream can be transmitted and received via a single channel,according to the above-described second exemplary embodiment.

The channel frequency band 700 includes a frequency band 710 for channel8, a frequency band 720 for channel 9, and a frequency band 730 forchannel 10.

A TS 740 for left-view video information and a TS 760 for right-viewvideo information may be transmitted and received as a stereo videothrough the frequency band 710 for channel 8. In this case, linkinginformation indicating existence of an association between videos of astereo video, namely, indicating that the videos are stereo linked, maybe set between an ES for the left-view video information and an ES forthe right-view video information or between an SP TS for the left-viewvideo information and an SP TS for the right-view video information.

A TS 750 for a normal 2D video and another TS 770 may be transmitted andreceived through the frequency band 710 for channel 8.

Accordingly, in a method of allocating a stereo video stream to channelsaccording to the second exemplary embodiment, a TS for a left-view videoand a TS for a right-view video are transmitted via a single channel.

FIG. 8 is a block diagram of a digital broadcasting stream transmittingapparatus 800 that transmits a plurality of TSs having linkinginformation via a single channel according to the second exemplaryembodiment described above with reference to FIG. 7.

The digital broadcasting stream transmitting apparatus 800 correspondsto a block diagram of the digital broadcasting stream transmittingapparatus 100 that is constructed according to the second exemplaryembodiment. In other words, operations of single-program encoders 810,820, and 830 and a MUX 840 of the digital broadcasting streamtransmitting apparatus 800 correspond to operations of the ES generationunit 110 and the TS generation unit 120 of the digital broadcastingstream transmitting apparatus 100 that are performed according to thesecond exemplary embodiment. Operations of a channel encoder andmodulator 850 and a DTV transmitter 860 of the digital broadcastingstream transmitting apparatus 800 correspond to an operation of thetransmission unit 130 of the digital broadcasting stream transmittingapparatus 100 that is performed according to the second exemplaryembodiment.

The single-program encoders 810, 820, and 830 may receive a left-viewvideo sequence Left Seq., a 2D video sequence 2D Seq., and a right-viewvideo sequence Right Seq., respectively, to generate and output a firstsingle-program transport stream SP TS1, a second single-programtransport stream SP TS2, and a third single-program transport stream SPTS3, respectively.

The first single-program transport stream SP TS1, the secondsingle-program transport stream SP TS2, and the third single-programtransport stream SP TS3 may be multiplexed by the MUX 840 to generate amulti-program transport stream MP TS. In other words, the first, second,and third single-program transport streams SP TS1, SP TS2, and SP TS3for the left-view video sequence, the 2D video sequence, and theright-view video sequence may be multiplexed together to generate asingle multi-program transport stream MP TS

The multi-program transport stream MP TS may be encoded and modulatedaccording to channel 8 by the channel encoder and modulator 850. The DTVtransmitter 860 may transmit a broadcasting video stream allocated tochannel 8. Thus, the digital broadcasting stream transmitting apparatus800 and the digital broadcasting stream transmitting apparatus 100according to the second embodiment may multiplex a single-programtransport stream for each of a left-view video of a stereo video, aright-view video of the stereo video, and a 2D video into a singlemulti-program transport stream and transmit the single multi-programtransport stream via a single channel.

The single program encoder 810 for the left-view video may set linkinginformation 815 for identifying the right-view video as corresponding tothe left-view video and may insert the linking information 815 into PMTinformation of the first single-program transport stream SP TS1. Thesingle program encoder 830 for the right-view video may set linkingInformation 835 for identifying the left-view video as corresponding tothe right-view video and may insert the linking information 835 into PMTinformation of the third single-program transport stream SP TS3. If avideo associated with the 2D video exists, the single program encoder820 for the 2D video may set linking information 825 for identifying theassociated video and may insert the linking information 825 into PMTinformation of the second single-program transport stream SP TS2.

The single program encoders 810, 820, and 830 according to the secondexemplary embodiment may follow individual digital data communicationsystems. For example, an Advanced Television Systems Committee (ATSC)terrestrial broadcasting communication method supports EnhancedVestigial Sideband (E-VSB) technology. In the E-VSB technology, a TS maybe constructed in a different way from that in the MPEG technology. Forexample, since linking information according to an exemplary embodimentis inserted into a TS to be transmitted, a base-view video stream may betransmitted in the form of an MPEG transport stream, and anadditional-view video stream may be transmitted in the form of an E-VSBtransport stream.

The single program encoders 810, 820, and 830 according to the secondexemplary embodiment may follow individual video encoding systems. Sincethe linking information according to an exemplary embodiment is insertedinto PMT information of a TS, a base-view video may be encoded accordingto an MPEG-2 video encoding method, and an additional-view video may beencoded according to an MPEG Advanced Video Coding (AVC)/H.264 videoencoding method.

According to the second exemplary embodiment, the digital broadcastingstream receiving apparatus 200 may receive a single multi-programtransport stream for a left-view video of a stereo video, a right-viewvideo of the stereo video, and a 2D video transmitted via a singlechannel, demultiplex the single multi-program transport stream into asingle-program transport stream for the left-view video, asingle-program transport stream for the right-view video, and asingle-program transport stream for the 2D video, and extract at leastone from the single-program transport streams, thereby restoring desiredvideo sequence data.

According to the second exemplary embodiment, the ES extraction unit 220of the digital broadcasting stream receiving apparatus 200 may extractlinking information. The reproduction unit 230 according to the secondexemplary embodiment may identify a right-view video sequencecorresponding to a left-view video sequence by using the linkinginformation and thus perform 3D reproduction. The linking informationmay also be used by the ES extraction unit 220 when searching for athird single-program transport stream corresponding to a firstsingle-program transport stream and extracting ESs from the first andthird single-program transport streams, respectively.

FIG. 9 is a block diagram of a digital broadcasting stream transmittingapparatus 900 that transmits a single TS including a 3D video stream anda 2D video stream via a single channel according to the above-describedthird exemplary embodiment.

The digital broadcasting stream transmitting apparatus 900 correspondsto a block diagram of the digital broadcasting stream transmittingapparatus 100 that is constructed according to the third exemplaryembodiment. In other words, operations of a single-program encoder 910and a MUX 980 of the digital broadcasting stream transmitting apparatus900 correspond to operations of the ES generation unit 110 and the TSgeneration unit 120 of the digital broadcasting stream transmittingapparatus 100 that are performed according to the third exemplaryembodiment. Operations of a channel encoder and modulator 990 and a DTVtransmitter 995 of the digital broadcasting stream transmittingapparatus 900 correspond to an operation of the transmission unit 130 ofthe digital broadcasting stream transmitting apparatus 100 that isperformed according to the third exemplary embodiment.

The single-program encoder 910 may receive a left-view video, aright-view video, and a 2D video and generate a first video elementarystream Video ES1, a second video elementary stream Video ES2, and athird video elementary stream Video ES3 by using video encoders 920,930, and 940, respectively. The first, second, and third videoelementary streams Video ES1, Video ES2, and Video ES3 are packetizedinto a first video PES packet Video PES1, a second video PES packetVideo PES2, and a third video PES packet Video PES3 by packetizers 925,935, and 945, respectively.

The single program encoder 910 may receive audio, convert the audio intoan audio elementary stream Audio ES by using an audio encoder 950, andconvert the audio elementary stream Audio ES into an audio PES packetAudio PES by using a packetizer 955.

A MUX 960 of the single program encoder 910 may multiplex the first,second, and third video PES packets and the audio PES packet into afirst single-program transport stream SP TS1. The single program encoder910 may also receive PMT information generated by a PSI and PSIPgenerator 970 and a variety of additional data DATA and multiplex thePMT information and the additional data DATA together with the first,second, and third video PES packets and the audio PES packet by usingthe MUX 960, so that the PMT information and the additional data DATAare inserted into the first single-program transport stream SP TS1. Thefirst single-program transport stream SP TS1 may then be output.

At least one of the 3D video data and other 2D video data may bemultiplexed with PMT information into a second single-program transportstream SP TS2. The PSI and PSIP generator 970 may generate PATinformation including PIDs of the PMT information included in the firstand second single-program transport streams SP TS1 and SP TS2, and aPSIP about various programs and system information. A MUX 980 maymultiplex the first and second single-program transport streams SP TS1and SP TS2, the PAT information, and the PSIP into a singlemulti-program transport stream MP TS.

The multi-program transport stream MP TS may be encoded and modulatedaccording to a channel by the channel encoder and modulator 990. The DTVtransmitter 995 may transmit a broadcasting video stream allocated tothe channel. Thus, the digital broadcasting stream transmittingapparatus 900 and the digital broadcasting stream transmitting apparatus100 according to the third exemplary embodiment may multiplex ESs forall of a left-view video of a stereo video, a right-view video of thestereo video, and a 2D video into a single single-program transportstream, and transmit a single multi-program transport stream via asingle channel.

The single program encoder 910 may set linking information foridentifying a left-view video or a right-view video corresponding toeach other as videos of a stereo video, namely, indicating that thevideos are stereo linked, to the first or second video PES packet,respectively, and may insert the stereo linked into PMT information ofthe first single-program transport stream SP TS1.

The single program encoder 910 according to the third exemplaryembodiment may generate a TS according to independent digital datacommunication methods. For example, the first single-program transportstream SP TS1 may be generated in the form of an MPEG transport stream,the second single-program transport stream SP TS2 may be transmitted inthe form of an E-VSB transport stream, and linking information may beinserted into each of the PMT information of the first and secondsingle-program transport streams SP TS1 and SP TS2. The video encoders920 and 930 according to the third exemplary embodiment may followindependent video encoding methods. For example, a base-view video maybe encoded according to an MPEG-2 video encoding method, anadditional-view video may be encoded according to an MPEG AVC/H.264video encoding method, and linking information may be inserted into eachof the PMT information of the first and second single-program transportstreams SP TS1 and SP TS2.

According to the third exemplary embodiment, the digital broadcastingstream receiving apparatus 200 may extract a single multi-programtransport stream for a left-view video of a stereo video, a right-viewvideo of the stereo video, a 2D video, and audio transmitted via asingle channel, and demultiplex the single multi-program transportstream, thereby selecting and extracting a desired single-programtransport stream. In addition, the digital broadcasting stream receivingapparatus 200 according to the third exemplary embodiment may select andextract a video ES for the left-view video of the stereo video, a videoES for the right-view video of the stereo video, and a video ES for the2D video from the extracted single-program transport stream, therebyrestoring desired video data.

According to the third exemplary embodiment, the ES extraction unit 220of the digital broadcasting stream receiving apparatus 200 may extractlinking information. The reproduction unit 230 according to the thirdexemplary embodiment may identify right-view video data corresponding toleft-view video data by using the linking information and thusaccurately reproduce a 3D video. The linking information may also beused by the ES extraction unit 220 when searching for and extracting asecond video ES corresponding to a first video ES.

FIG. 10 is a block diagram of a digital broadcasting stream receivingapparatus 1000 that receives a plurality of TSs via a plurality ofchannels based on a plurality of transmission network systems accordingto the above-described fourth exemplary embodiment.

According to the fourth exemplary embodiment, the digital broadcastingstream transmitting apparatus 100 receives a TS for a left-view videoand a TS for a right-view video via different channels that are based onindividual transmission network system, for example, a terrestrialsystem 1010, a satellite TV system 1012, a cable TV system 1014, anInternet Protocol Television (IPTV) system 1016, and the like.

The digital broadcasting stream receiving apparatus 1000 corresponds toa block diagram of the digital broadcasting stream receiving apparatus200 that is constructed according to the fourth exemplary embodiment. Inother words, operations of either a terrestrial digital tuner 1020 or asatellite digital tuner 1060 and channel decoder and demodulators 1030and 1070 of the digital broadcasting stream receiving apparatus 1000 maycorrespond to an operation of the TS receiving unit 210 of the digitalbroadcasting stream receiving apparatus 200 that is performed accordingto the fourth exemplary embodiment, and operations of TS DEMUXes 1040and 1080 and single-program decoders 1050 and 1090 of the digitalbroadcasting stream receiving apparatus 1000 may correspond to anoperation of the ES extraction unit 220 of the digital broadcastingstream receiving apparatus 200 that is performed according to the fourthexemplary embodiment.

The digital broadcasting stream receiving apparatus 1000 may be adigital TV receiving system. The digital broadcasting stream receivingapparatus 1000 may receive broadcasting streams via channelscorresponding to the terrestrial system 1010, the satellite TV system1012, the cable TV system 1014, and the IPTV system 1016.

The terrestrial digital tuner 1020 and the channel decoder anddemodulator 1030 are tuned to a terrestrial channel to extract amulti-program transport stream received via terrestrial waves. In thiscase, a TS for a left-view video of a stereo video may be received viathe terrestrial channel.

The satellite digital tuner 1060 and the channel decoder & demodulator1070 are tuned to a satellite channel to extract a multi-programtransport stream received via satellite waves. In this case, a TS for aright-view video of the stereo video may be received via the satellitechannel.

The multi-program transport streams may be demultiplexed intosingle-program transport streams by the TS DEMUXes 1040 and 1080. Thesingle-program transport streams may be restored to a left-view videoand a right-view video by the single-program decoders 1050 and 1090,respectively.

In this case, the single-program transport stream for the left-viewvideo received and extracted via the terrestrial channel may includelinking information 1055 about the right-view video constituting aremaining view of a stereo image. In this case, linking information ofthe left-view video may include an identifier indicating a channel, aTS, or an ES of the right-view video received via the satellite channel.

The single-program transport stream for the right-view video receivedand extracted via the satellite channel may include linking information1095 about the left-view video. Linking information of the right-viewvideo may include an identifier indicating a channel, a TS, or an ES ofthe right-view video received via the terrestrial channel.

The digital broadcasting stream receiving apparatus 1000 may detect theleft-view video and the right-view video received via the terrestrialchannel and the satellite channel, respectively, by using the linkinginformation to reproduce a 3D video, thereby providing 3D videobroadcasting services.

FIG. 11 illustrates an example of a distribution of a channel frequencyband 1100 in which a plurality of TSs for a left-view video stream of a3D video can be transmitted and received via a plurality of channels andin which a TS for a right-view video stream for the 3D video can betransmitted and received via a single channel, according to theabove-described fifth exemplary embodiment.

The channel frequency band 1100 includes a frequency band 1110 forchannel 8, a frequency band 1120 for channel 9, and a frequency band1130 for channel 10.

According to the fifth exemplary embodiment, a left-view video LeftVideo 1 of a first stereo video and a left-view video Left Video 2 of asecond stereo video are allocated to the frequency band 1120 for channel9 and the frequency band 1130 for channel 10, respectively. A TS 1140for a right-view video Right Video 1 of the first stereo video and a TS1150 for a right-view video Right Video 2 of the second stereo video maybe transmitted and received through the frequency band 1110 for channel8.

In this case, linking information indicating existence of an associationbetween videos of a stereo video, namely, indicating that the videos arestereo linked, may be set between channels (video streams) of theleft-view video Left Video 1 and the right-view video Right Video 1 ofthe first stereo video and between channels (video streams) of theleft-view video Left Video 2 and the right-view video Right Video 2 ofthe second stereo video.

Although not shown in FIG. 11, if another left-view video is allocatedto another channel, a TS 1160 for another right-view video may betransmitted via the frequency band 1110 for channel 8. If the channelfrequency band 1100 is sufficiently large, a TS 1170 for other data maybe further transmitted.

Accordingly, the digital broadcasting stream transmitting apparatus 100according to the fifth exemplary embodiment may multiplex an ES for atleast one left-view video to generate at least one single-programtransport stream for the at least one left-view video, and generate atleast one left-view multi-program transport stream from the at least onesingle-program transport stream. The digital broadcasting streamtransmitting apparatus 100 according to the fifth exemplary embodimentmay also multiplex an ES for at least one right-view video correspondingto the at least one left-view video to generate at least onesingle-program transport stream for the at least one right-view video,and generate a single right-view multi-program transport stream from theat least one single-program transport stream. Accordingly, the digitalbroadcasting stream transmitting apparatus 100 according to the fifthexemplary embodiment may transmit the at least one left-viewmulti-program transport stream and the single right-view multi-programtransport stream via different channels.

The digital broadcasting stream receiving apparatus 200 according to thefifth exemplary embodiment may decode a plurality of channels to receivea left-view multi-program transport stream of a 3D video from at leastone of the channels and receive a right-view multi-program transportstream of the 3D video from one of the channels. The digitalbroadcasting stream receiving apparatus 200 according to the fifthexemplary embodiment may demultiplex the at least one left-viewmulti-program transport stream individually to extract at least oneleft-view single-program transport stream, and demultiplex the at leastone left-view single-program transport stream individually to extract atleast one left-view elementary stream. The ES extraction unit 220according to the fifth exemplary embodiment may demultiplex a singleright-view multi-program transport stream to extract at least oneright-view single-program transport stream, and demultiplex the at leastone right-view single-program transport stream individually to extractat least one right-view elementary stream.

Accordingly, the digital broadcasting stream receiving apparatus 200according to the fifth exemplary embodiment may extract a plurality ofESs for 3D video information or 2D video information via a plurality ofchannels. In addition, the digital broadcasting stream receivingapparatus 200 according to the fifth exemplary embodiment may reproducemutually associated stereo videos three-dimensionally by using linkinginformation.

The first through fifth exemplary embodiments of the digitalbroadcasting stream transmitting apparatus 100 and the digitalbroadcasting stream receiving apparatus 200 have been described abovewith reference to FIGS. 5 through 11 in relation to a stereo video of a3D video. However, it is understood that another exemplary embodiment isnot limited to stereo images. For example, a 3D video may be amulti-view video including at least three view videos.

According to the above-described first through fifth exemplaryembodiments, a plurality of video streams associated with one anothermay be transmitted or received via at least one channel and at least oneTS.

According to the second and third exemplary embodiments, a left-viewvideo stream and a right-view video stream associated with each othermay be transmitted or received via a single channel. For example, a casewhere the second or third exemplary embodiment is implemented so as tomaintain compatibility with related art 2D digital terrestrialbroadcasting systems is supposed. When a 2D digital terrestrialbroadcasting system transmits and receives a single video stream withina frequency band of around 19.38 Mbps at a first bitrate, the 2D digitalterrestrial broadcasting system may transmit and receive a base-viewvideo stream at a second bitrate lower than the first bitrate and anadditional-view video stream at remaining bitrate in order to implementthe second or third exemplary embodiment.

According to the second and third exemplary embodiments, both base-viewvideo information and additional-view video information are transmittedand received via a single channel, and thus compatibility with existingbroadcasting systems is possible without using additional channels. Whenvideo data is compressed using a high-compressibility encoding anddecoding method, data loss due to compression of a base-view videostream is minimized, and the base-view video stream may be transmittedand received via a single channel together with additional-view videoinformation.

According to the first, fourth, and fifth exemplary embodiments, abase-view video stream and an additional-view video stream may betransmitted and received via a plurality of channels. For example, ifthe first, fourth, or fifth exemplary embodiment is implemented to allowmaintaining of compatibility with related art 2D digital terrestrialbroadcasting systems, a base-view video stream may be transmitted via anexisting channel, and an additional-view video stream may be transmittedvia an additional channel.

According to the first, fourth, and fifth exemplary embodiments,base-view video information and additional-view video information aretransmitted and received via different channels, and thus if the first,fourth, and fifth exemplary embodiments are compatible with related artbroadcasting systems on a channel-by-channel basis, multi-view digitalcontents broadcasting services may be provided without degradation ofthe quality of a displayed image.

FIG. 12 illustrates an example of a distribution of a channel frequencyband 1200 in which a plurality of TSs for a multi-view video stream canbe transmitted and received via a single channel, according to anexemplary embodiment.

The channel frequency band 1200 includes a frequency band 1210 forchannel 8 and a frequency band 1220 for channel 9, and the like.

According to the present exemplary embodiment, a TS 1230 for first viewvideo information Video 1 of a multi-view video, a TS 1240 for secondview video information Video 2 of the multi-view video, a TS 1250 forthird view video information Video 3 of the multi-view video, a TS 1260for fourth view video information Video 4 of the multi-view video, and aTS 1270 for fifth view video information Video 5 of the multi-view videomay be transmitted and received through the frequency band 1210 forchannel 8.

If the third view video information Video 3 is a main view video,linking information ‘3d linked’ for representing that a link existsbetween each of the first, second, fourth, and fifth view videoinformation Video 1, Video 2, Video 4, and Video 5 and the third viewvideo information Video 3, may be set.

The digital broadcasting stream transmitting apparatus 100 according tothe present exemplary embodiment for achieving multi-view video servicesmay convert ESs of videos of a plurality of views that constitute amulti-view video, into single-program transport streams, respectively,multiplex the single-program transport streams for the respective viewsinto a single multi-program transport stream, and transmit the singlemulti-program transport stream via a single channel. Hereinafter, thevideos of the plurality of views are referred to as a plurality of viewvideos.

The digital broadcasting stream receiving apparatus 200 according to thepresent exemplary embodiment for achieving multi-view video services maydecode a single channel to extract a single multi-program transportstream, and may demultiplex the single multi-program transport stream toextract respective single-program transport streams for a plurality ofview videos. The plurality of view videos constitute a multi-view video,and respective ESs for the view videos may be extracted from thesingle-program transport streams for the view videos. Accordingly, thedigital broadcasting stream receiving apparatus 200 according to thepresent exemplary embodiment may finally extract the single-programtransport streams of the view videos and the ESs of the view videos viaa single channel and thus reproduce restored view videos.

Since the digital broadcasting stream transmitting apparatus 100according to the exemplary embodiment of FIG. 1 transmits mutuallyassociated pieces of video information via different channels, TSs, orESs, the digital broadcasting stream receiving apparatus 200 accordingto the exemplary embodiment of FIG. 2 may check what channel, TS, or ESvideo information associated with extracted video information has beenreceived through. To this end, the digital broadcasting streamtransmitting apparatus 100 and the digital broadcasting stream receivingapparatus 200 according to the exemplary embodiments of FIGS. 1 and 2use linking information representing association between 3D videos suchas stereo videos or multi-view videos.

Since the digital broadcasting stream transmitting apparatus 100according to the exemplary embodiment of FIG. 1 converts mutuallyassociated pieces of 3D video information into a transmission format andtransmits the mutually associated 3D video information pieces in thetransmission format, the digital broadcasting stream receiving apparatus200 according to the exemplary embodiment of FIG. 2 may ascertain thefeatures of a 3D video in order to properly restore the mutuallyassociated 3D video information pieces into a 3D reproduction format andreproduce the mutually associated 3D video information pieces in the 3Dreproduction format. Accordingly, the digital broadcasting streamtransmitting apparatus 100 and the digital broadcasting stream receivingapparatus 200 according to the exemplary embodiments of FIGS. 1 and 2use a 3D video start descriptor or a 3D video registration descriptorfor representing existence or absence of 3D video information, and a 3Dvideo stream descriptor for accurate restoration and reproduction of the3D video information.

Exemplary embodiments in which the digital broadcasting streamtransmitting apparatus 100 of FIG. 1 and the digital broadcasting streamreceiving apparatus 200 of FIG. 2 transmit and receive linkinginformation, a 3D video start descriptor or a 3D video registrationdescriptor, and a 3D video stream descriptor by using PSI will now bedescribed with reference to Tables 1 through 18.

The linking information according to an exemplary embodiment may includea link identifier representing whether associated pieces of videoinformation exist in a plurality of pieces of video information includedin a TS, and a link descriptor used to identify an ES, a TS, or achannel of video information associated with each video information.

The TS generation unit 120 of the digital broadcasting streamtransmitting apparatus 100 of FIG. 1 may insert the link identifieraccording to an exemplary embodiment into PAT information. The ESextraction unit 220 of the digital broadcasting stream receivingapparatus 200 of FIG. 2 checks a link identifier included in PATinformation extracted from a TS and predict a link between pieces of PMTinformation included in the TS. Mutually associated pieces of PMTinformation include a link descriptor that defines a link between piecesof video information.

For example, parameter ‘linked_indicator’ including a link identifiermay be additionally set for each PMT information within the PATinformation. If parameter ‘linked_indicator’ of current PMT informationis 000, no PMT information from among at least one piece of opponent PMTinformation indicated by the PAT information is associated with thecurrent PMT information. On the other hand, if parameter‘linked_indicator’ of the current PMT information is one among 001 to111, PMT information including parameter ‘linked_indicator’ with thesame value as that of the current PMT information, from among the atleast one piece of opponent PMT information indicated by the PATinformation, is associated with the current PMT information. In otherwords, PMT information pieces including parameters ‘linked_indicator’with the same value may each include a link descriptor that defines alink therebetween.

The TS generation unit 120 of the digital broadcasting streamtransmitting apparatus 100 of FIG. 1 may insert a link describeraccording to an exemplary embodiment into PMT information. The linkdescriber may be set for each video information. The ES extraction unit220 of the digital broadcasting stream receiving apparatus 200 of FIG. 2may check a link describer included in PMT information extracted from asingle-program transport stream and determine a location of opponentvideo information corresponding to the video information included in thesingle-program transport stream. Thus, the digital broadcasting streamreceiving apparatus 200 of FIG. 2 may detect mutually associated piecesof video information and restore video data from the mutually associatedvideo information pieces.

Table 1 shows an example of a syntax of parameter ‘program_stream_map()’ of PMT information. The link describer according to an exemplaryembodiment is included in parameter ‘linking_descriptor’. The parameter‘linking_descriptor’ may be included in parameter ‘descriptor( )’ as adescriptor region following parameter ‘elementary_stream_info_length’included in parameter ‘program_stream_map( )’.

TABLE 1 Syntax Program_stream_map( ) {   packet_start_code_prefix  map_stream_id   program_stream_map_length   current_next_indicator  reserved   program_stream_map_version   reserved   marker_bit  program_stream_info_length   for (i = 0; i < N; i++) {     descriptor()   )   elementary_stream_map_length   for(i = O; i < N1; i++) {    stream_type     elementary_stream_id      elementary_stream_info_length       for (i = 0; i < N2; i++){        descriptor( )     }   }   CRC_32 }

The TS generation unit 120 of the digital broadcasting streamtransmitting apparatus 100 of FIG. 1 may insert a 3D video startdescriptor or a 3D video registration descriptor according to anexemplary embodiment, as 3D video authentication information, into aPMT. The ES extraction unit 220 of the digital broadcasting streamreceiving apparatus 200 of FIG. 2 may check a 3D video start descriptoror a 3D video registration descriptor included in PMT informationextracted from a single-program transport stream, and predict whethervideo information of an ES for the single-program transport stream isinformation about a 3D video. In addition, if it is determined based onthe 3D video start descriptor or the 3D video registration descriptorthat a 3D video stream descriptor is included in the PMT information,the ES extraction unit 220 may extract the 3D video stream descriptorfrom the PMT information and extract 3D video information from the ES.

Parameter ‘3d_start_descriptor’ used to set a 3D video start descriptoror parameter ‘3d_registration_descriptor’ used to set a 3D videoregistration descriptor may be included in parameter ‘descriptor( )’,which is a descriptor region following parameter‘program_stream_info_length’ included in the PMT of Table 1.

Table 2 shows an example of a syntax of parameter ‘3d_start_descriptor’that represents the 3D video start descriptor.

TABLE 2 Syntax 3d_start_descriptor( ){   descriptor_tag  descriptor_length   threed_info_start_code - }

Descriptors defined by a user may be inserted into a parameter‘descriptor_tag’ having a value between 64˜255, in a descriptor regionof an MPEG TS. For example, the TS generation unit 120 of the digitalbroadcasting stream transmitting apparatus 100 of FIG. 1 may insertparameter ‘3d_start_descriptor’, representing the 3D video startdescriptor, into a descriptor region having parameter ‘descriptor_tag’with a value of 0xF0.

Parameter ‘descriptor_length’ represents the number of bytes that followparameter ‘descriptor_length’. ASCII code ‘3DAV’ may be set as the valueof parameter ‘threed_info_start_code’ so that 3D video information isincluded in the single-program transport stream and a 3D video streamdescriptor is included in PMT information.

Table 3 shows an example of a syntax of parameter‘3d_registration_descriptor’ that represents a 3D video registrationdescriptor.

TABLE 3 Syntax 3d_registration_descriptor( ){   descriptor_tag  descriptor_length   format_identifier   for(i = 0 ; i < N; i++){   private_data_byte   } }

ASCII code ‘3DAV’ may be set as the value of parameter‘format_identifier’ so that parameter ‘format_identifier’ representsthat 3D video format data is included in the single-program transportstream and a 3D video stream descriptor is included in the PMT.

Table 4 shows an example of a syntax of parameter ‘linking_descriptor’that represents a link descriptor.

TABLE 4 Syntax linking_descriptor( ){   descriptor_tag  descriptor_length   linking_priority   distribution_indicator_flag  channel_indicator_flag   pmt_indicator_flag   simulcast_flag  Reserved   if(distribution_indicator_flag){    linked_distribution_method   }   if(channel_indicator_flag){      linked_ts_id     linked_channel   }   if(pmt_indicator_flag){    linked_pmt_pid     Reserved   }   linked_stream_PID  if(simulcast_flag){     linked_service_identification_time   }  Reserved }

Parameter ‘linking_priority’ represents linking priority informationthat indicates existence or absence of a link between a plurality ofvideo streams and priority between associated video streams. Anexemplary embodiment of the values of parameter ‘linking_priority’ thatdefine a link between a current video stream and an opponent videostream associated with the current video stream is based on Table 5.

TABLE 5 linking_priority Description 00 no linking The two video streamsare not linked with each other. 01 linking_no_priorty The two videostreams are linked with each other, but they are equal to each otherwithout priority. 10 linking_high_priorty The current video stream islinked with the opponent video stream and has higher priority than theopponent video stream. 11 linking_low_priorty The current video streamis linked with the opponent video stream and has lower priority than theopponent video stream.

If the value of parameter ‘linking_priority’ is 00, the two videostreams are not linked to each other.

If the value of parameter ‘linking_priority’ is 01, the two videostreams are equally linked to each other without priorities. In thiscase, when two video streams are independently encoded to have an equalrelationship as in the first exemplary embodiment, the value ofparameter ‘linking_priority’ may be set to be 01 for each channel.

When a reference view and an additional view of a stereo video areaccurate, the value of parameter ‘linking_priority’ may be set to be 10or 11. When the value of parameter ‘linking_priority’ is 10, the currentvideo stream has higher priority than the opponent video stream. Whenthe value of parameter ‘linking_priority’ is 11, the current videostream has lower priority than the opponent video stream. In otherwords, when the current video stream includes video information of thereference view, the value of parameter ‘linking_priority’ may be set tobe 10. When the current video stream includes video information of theadditional view, the value of parameter ‘linking_priority’ may be set tobe 11.

Parameter ‘distribution_indicator_flag’ represents same transmissionnetwork method information that indicates whether mutually associatedvideo streams are transmitted and received using the same transmissionnetwork method.

For example, when the value of parameter ‘distribution_indicator_flag’is 0, it may indicate that the mutually associated video streams aretransmitted and received using the same transmission network method.When the value of parameter ‘distribution_indicator_flag’ is 1, it mayindicate that the mutually associated video streams are transmitted andreceived using different transmission network methods.

Parameter ‘channel_indicator_flag’ represents same channel informationthat indicates whether mutually associated pieces of video informationare transmitted via the same channel.

For example, when the value of parameter ‘channel_indicator_flag’ is 0,it may indicate that the mutually associated video streams use the samechannel. When the value of parameter ‘channel_indicator_flag’ is 1, itmay indicate that the mutually associated video streams use differentchannels. In the second and third exemplary embodiments where left-viewvideo information and right-view video information linked to each otherare transmitted via a single channel as described above with referenceto FIGS. 7, 8, and 9, the value of parameter ‘channel_indicator_flag’may be set to be 0. In the other exemplary embodiments, the value ofparameter ‘channel_indicator_flag’ may be set to be 1.

Parameter ‘pmt_indicator_flag’ represents same single-program transportstream information that represents whether the mutually associated videostreams exist within the same single-program transport stream.

For example, when the value of parameter ‘pmt_indicator_flag’ is 0, itmay indicate that the mutually associated video streams such as ESs,PESs, or the like exist within the same single-program transport stream.When the value of parameter ‘pmt_indicator_flag’ is 1, it may indicatethat the mutually associated video streams such as ESs, PESs, or thelike exist within different single-program transport streams,respectively. In the third exemplary embodiment described above withreference to FIG. 9 where left-view video information and right-viewvideo information linked to each other are included in a singlesingle-program, the value of parameter ‘pmt_indicator_flag’ may be setto be 0. In other exemplary embodiments, the value of parameter‘pmt_indicator_flag’ may be set to be 1.

Parameter ‘simulcast_flag’ represents same view information thatrepresents whether mutually associated video streams of the same viewexist.

For example, when the value of parameter ‘simulcast_flag’ is 0, it mayindicate that mutually associated video streams exist as videoinformation of the same view. When the value of parameter‘simulcast_flag’ is 1, it may indicate that mutually associated videostreams do not exist at the same point of time but data may be providedlater.

Parameter ‘linked_distribution_method’ represents linked videotransmission network method information that represents the transmissionnetwork method of a channel through which the opponent video stream istransmitted. When the value of parameter ‘distribution_indicator_flag’representing the same transmission network method information is 1, thelinked video transmission network method information may be set todefine a transmission network method for the opponent video stream.Table 6 shows an example of the linked video transmission network methodinformation.

TABLE 6 linked_distribution_method Description 0x00 terrestrialbroadcasting 0x01 satellite broadcasting 0x02 cable broadcasting 0x03IPTV broadcasting 0x04~0xFF reserved

Parameter ‘linked_ts_id’ represents linked TS PID information thatindicates a PID of a multi-program TS including mutually associatedvideo streams.

Parameter ‘linked_channel’ represents linked video channel informationthat represents a channel through which an opponent video stream fromamong the mutually associated video streams is transmitted and received.When the value of parameter ‘channel_indicator_flag’ representing thesame channel information is 1, the linked video channel information maybe set.

In satellite broadcasting, terrestrial broadcasting, and cablebroadcasting, frequency information may be provided as the linked videochannel information. In IPTV broadcasting, Uniform Resource Locator(URL) information may be provided as the linked video channelinformation.

Parameter ‘linked_pmt_pid’ represents linked video PID information thatindicates a PID of a PMT of a single-program transport stream throughwhich the opponent video stream is transmitted. When the value ofparameter ‘pmt_indicator_flag’ representing the same single-programtransport stream information is 1, linked video packet identifierinformation may be defined.

Parameter ‘linked_stream_PID’ represents linked video stream PIDinformation that indicates a PID of an opponent video stream from amongthe mutually associated video streams.

Parameter ‘linked_service_identification_time’ represents linked videoservice identifying time information that represents when a program forthe opponent video stream from among the mutually associated videostreams is provided. For example, the linked video service identifyingtime information may indicate, in units of months, days, hours, andminutes, when a linked program is provided.

The digital broadcasting stream transmitting apparatus 100 of FIG. 1 maytransmit linking information such as a link descriptor, a linkidentifier, and the like for identifying existence and locations of themutually associated video streams, together with the mutually associatedvideo streams. The digital broadcasting stream receiving apparatus 200of FIG. 2 may extract link information and video streams from a receivedTS and also extract mutually associated video streams according to thelinking information, thereby properly reproducing 3D video.

An example in which a link descriptor is used between non-linked videostreams is as follows. When the value of parameter ‘linking_priority’representing link priority information is 00, since information used toidentify an opponent video stream linked to a current video stream isnot defined, the values of parameters ‘distribution_indicator_flag’,‘channel_indicator_flag’, and ‘pmt_indicator_flag’ are set to be 0. Thevalue of parameter ‘linked_stream_PID’ may be set to be a PID valuenewly defined for video information for an additional view video of a 3Dvideo.

The PMT information according to an exemplary embodiment may includeparameter ‘linked_network_id’ representing service provider informationor broadcasting station information that provides a TS. In a databroadcasting system based on a Digital Video Broadcasting (DVB) method,a TS is identified using parameter ‘transport_stream_id’, and theservice provider information or the broadcasting station information isidentified using parameter ‘original_network_id’. Thus, programsinserted into the TS may be securely distinguished from each other.Accordingly, when the digital broadcasting stream receiving apparatus200 of FIG. 2 follows the DVB method, stereo link information may beaccurately determined using parameter ‘linked_network_id’ instead ofusing parameter ‘linked_channel’. The value of parameter‘linked_channel’ denotes a channel of the opponent video informationassociated with the current TS, and may vary according to a broadcastingmethod or the type of a broadcasting system.

The link descriptor according to an exemplary embodiment is not limitedto that shown in Table 4, and may be appropriately changed according toa case where the link descriptor is expanded to include a multi-viewimage or used for a predetermined purpose.

The linking information described up to now may be set for each videoinformation. However, in cases where linking information about a linkfrom an additional view to a reference view is not used, including caseswhere a single-program that can be selected by a user according to userinputs, system environments, communication environments, and the like isfixed to only the reference view, unidirectional linking information inwhich linking information is set for only base-view video informationmay be used.

The TS generation unit 120 of the digital broadcasting streamtransmitting apparatus 100 of FIG. 1 may insert a 3D video streamdescriptor for a current video stream into PMT information for thecurrent video stream. The ES extraction unit 220 of the digitalbroadcasting stream receiving apparatus 200 of FIG. 2 may extract the 3Dvideo stream descriptor from the PMT information for the current videostream. The 3D video stream descriptor includes additional informationthat is used when the reproduction unit 230 of the digital broadcastingstream receiving apparatus 200 of FIG. 2 performs 3D rendering toaccurately restore and reproduce video data of the current video stream.

Table 7 shows parameter ‘3d_video_stream_descriptor’ including a 3Dvideo stream descriptor according to an exemplary embodiment.

TABLE 7 Syntax 3d_video_stream_descriptor( ){   descriptor_tag  descriptor_length   3d_video_property   linked_stream_coding_mode  full_image_size_indicator   if(3d_video_property == 0x0f){    3d_composite_format     is_left_first   }  if(full_image_size_indicator == 0){     additional_view_image_size    scaling_method     scaling_order   }   if(3d_video_property == 3D) {    Is_Main     picture_display_order     view_info   }   elseif(3d_video_property == 2D_Multi){     view_index   }  es_icon_indicator   transition_indicator   transition_time_stamp  transition_message   Reserved }

Parameter ‘3d_video_property’ represents 3D video property informationthat represents video properties of the current video stream when a 3Dvideo is constructed.

3D video property information according to an exemplary embodiment maybe defined with reference to Table 8 below.

TABLE 8 3d_video_property Description 0x00 Left video 0x01 Right video0x02 2D video 0x03 depth 0x04 disparity 0x05 3D_DOT 0x06 2D_Multi0x07~0x0e reserved 0x0f 3d_composite_format

When the value of parameter ‘3d_video_property’ of the current videostream is 0x00, the current video stream is a left-view video of astereo video. When the value of parameter ‘3d_video_property’ of thecurrent video stream is 0x01, the current video stream is a right-viewvideo of the stereo video.

When the value of parameter ‘3d_video_property’ of the current videostream is 0x02, the current video stream is a 2D video. When the valueof parameter ‘3d_video_property’ of the current video stream is 0x03 or0x04, the current video stream is depth information or disparityinformation, respectively, of an additional-view video for the left-viewvideo of the stereo video.

If the stereo video is constructed with 2D video information and depthinformation, the value of parameter ‘3d_video_property’ of a videostream including the 2D video information may be set to be 0x02, and thevalue of parameter ‘3d_video_property’ of a video stream including thedepth information may be set to be 0x03.

When the value of parameter ‘3d_video_property’ of the current videostream is 0x05, the 3D video is an image based on a 3D dot method or arandom dot stereogram method. When the value of parameter‘3d_video_property’ of the current video stream is 0x06, the currentvideo stream is a plurality of 2D video streams for a multi-view video.

When the value of parameter ‘3d_video_property’ of the current videostream is 0x0f, the current video stream is a video stream in a 3Dcomposite format that is obtained by composing a left-view image and aright-view image in a single frame, such as in a side-by-side format ora top-and-bottom format.

The other fields not defined in Table 8 may be reserved as reservedfields. Video formats of a new video property may be set in the reservedfields as a user demands. For example, a 3D composite format and a videoformat of a combination of depth information and disparity informationmay be allocated to reserved parameters as needed.

Parameter ‘linked_stream_coding_mode’ represents linked video encodingmethod information that represents a compressive encoding method betweenmutually associated pieces of video information. Linked video encodingmethod information according to an exemplary embodiment is set withreference to Table 9.

TABLE 9 linked_stream_coding_mode Description 000 independent coding 001scalable coding 010 differential image coding 011~111 reserved

When the value of parameter ‘linked_stream_coding_mode’ is 000, twomutually associated items of video data are independently encoded. Inthis case, the digital broadcasting stream transmitting apparatus 100 ofFIG. 1 may compress the two video data items by using two independentvideo encoders, respectively, and transmit the two video data items inthe form of two video streams. The digital broadcasting stream receivingapparatus 200 of FIG. 2 may receive the two video streams and restorevideo data from each of the two video streams by using two independentvideo decoders.

When the value of parameter ‘linked_stream_coding_mode’ is 001, themutually associated video data items are encoded using a scalable codingmethod. When the value of parameter ‘linked_stream_coding_mode’ is 010,a differential image between a left-view image and a right-view image isencoded as additional-view video information.

Parameter ‘full_image_size_indicator’ represents size indicatorinformation that indicates whether a current video stream transmitscurrent video information at the original size of the original videoinformation. For example, the size indicator information may represent arate at which video data of the current video stream is scaled withrespect to the original size of the original video data. When the valueof parameter ‘full_image_size_indicator’ is 0, the size of current videodata is not the same as the full size of the original video data. Whenthe value of parameter ‘full_image_size_indicator’ is 1, the size ofcurrent video data is the same as the full size of the original videodata.

Some polarization-type display devices halve the vertical resolution ofan image and display an image with halved vertical resolution. Even whenreceiving 3D video data at a full resolution, the polarization typedisplay devices halve the vertical resolution of the 3D video data anddisplay an image with halved vertical resolution. Since full-resolutionbase-view video data and full-resolution additional-view video data donot need to be provided to these display devices, providing half-sizevideo data obtained by halving a vertical resolution is efficient interms of the amount of transmission data and a data processing rate.

A base-view video is transmitted at a full resolution in considerationof compatibility with broadcasting systems for 2D contents services, andan additional-view video is transmitted and received at a half sizebecause it is used during 3D video reproduction, thereby efficientlytransmitting and receiving a video stream. In addition, depthinformation and disparity information may be transmitted and received ata ½ or ¼ size, and not at a full size.

In a side-by-side format from among 3D composite formats, the size of acomposite frame is an original size of a frame, and the sizes of aleft-view frame and a right-view frame that constitute the compositeframe may be reduced to a half size. Thus, in this case, the value ofparameter ‘full_image_size_indicator’ is not 1. If each of the left-viewframe and the right-view frame is constructed to have the full size ofthe original frame and thus the size of a 3D composite format frame istwice the size of the original frame, the value of parameter‘full_image_size_indicator’ may be set to be 1.

When 3D video property information of the current video stream is a 3Dcomposite format, that is, when the value of parameter‘3d_video_property’ represents ‘3d_composite_format’, parameter‘3d_composite_format’ and parameter ‘is_left_first’ may be set as below.

Parameter ‘3d_composite_format’ represents 3D composite formatinformation that represents a method of constructing 3D composite formatimages by composing images corresponding to a left-view video and aright-view video. The 3D composite format information corresponds to thetypes of 3D composite formats as in Table 10.

TABLE 10 3d_composite_format Description 0x00 Side by side format 0x01Top and bottom format 0x02 vertical line interleaved format 0x03horizontal line interleaved format 0x04 frame sequential format 0x05field sequential format 0x06 checker board format 0x07~0x7f reserved

When the value of parameter ‘3d_composite_format’ of the current videostream is 0x00, the 3D composite format of current video data is aside-by-side format. Similarly, when the value of parameter‘3d_composite_format’ of the current video stream is 0x01, 0x02, 0x03,0x04, 0x05, or 0x06, the 3D composite format of the current video datais a top-and-bottom format, a vertical line interleaved format, ahorizontal line interleaved format, a frame sequential format, a fieldsequential format, or a checker board format, respectively.

The side-by-side format is an image format in which a left-view imageand a right-view image respectively corresponding to a left region and aright region of a 3D composite format image are arranged side by side.The top-and-bottom format is an image format in which a left-view imageand a right-view image respectively corresponding to an upper region anda lower region of the 3D composite format image are arranged.

The vertical line interleaved format is an image format in which aleft-view image and a right-view image respectively corresponding toodd-numbered vertical lines and even-numbered vertical lines of the 3Dcomposite format image are arranged. The horizontal line interleavedformat is an image format in which a left-view image and a right-viewimage respectively corresponding to odd-numbered horizontal lines andeven-numbered horizontal lines of the 3D composite format image arearranged.

The frame sequential format is an image format in which a left-viewimage and a right-view image respectively corresponding to odd-numberedframes and even-numbered frames of the 3D composite format image arearranged. The field sequential format is an image format in which aleft-view image and a right-view image respectively corresponding toodd-numbered fields and even-numbered fields of the 3D composite formatimage are arranged.

The checker board format is an image format in which a left-view imageand a right-view image respectively corresponding to pixels in ahorizontal direction and pixels in a vertical direction of the 3Dcomposite format image are arranged alternately in units of pixels.

Parameter ‘is_left_first’ represents format arrangement sequenceinformation that represents a sequence in which a left-view image and aright-view image of the 3D composite format image are arranged.Parameter ‘is_left_first’ may represent which region is a left-viewimage of the 3D composite format image of the current video stream andwhich region is a right-view image thereof. Format arrangement sequenceinformation according to an exemplary embodiment is linked with the 3Dcomposite format information with reference to Table 11, so thatpositions of a left-view image and a right-view image of the 3Dcomposite format image may be set as follows.

TABLE 11 identification is_left_first = 0 is_left_first = 1 Left viewRight View Left view Right view Left view Side by side Left side Rightside Right side Left side format Top and Upper side Lower side Lowerside Upper side bottom format Vertical line Odd line Even line Even lineOdd line interleaved format Horizontal line Odd line Even line Even lineOdd line interleaved format Frame sequential Odd frame Even frame Evenframe Odd frame format Field sequential Odd field Even field Even fieldOdd field format Checker Odd pixel Even pixel Even pixel Odd pixel boardformat

When the value of parameter ‘is_left_first’ is 0, left video data isarranged in a left region of a side by side format image, an upperregion of a top and bottom format image, odd-numbered lines of avertical line interleaved format image, odd-numbered lines of ahorizontal line interleaved format image, odd-numbered frames of a framesequential format image, odd-numbered fields of a field sequentialformat image, and odd-numbered pixels of a checker board format image.Thus, right-view video data is arranged in a region opposite to theregion of each of the 3D composite format images where the left-viewvideo data is arranged.

When the value of parameter ‘is_left_first’ is 1, the right-view videodata and the left-view video data are arranged in a manner opposite tothe arrangement manner when the value of parameter ‘is_left_first’ is 0.

When the size indicator information of the current video streamrepresents that left-view and right-view video information istransmitted at a size reduced from the full size of the originalleft-view and right-view video information, that is, when the value ofparameter ‘full_image_size_indicator’ is 0, parameter‘additional_view_image_size’, parameter ‘scaling_method’, and parameter‘scaling_order’ may be set as follows.

Parameter ‘additional_view_image_size’ includes additional-view imagesize information that represents a rate at which the image size ofadditional-view video information of the current video stream isenlarged or reduced from the original image size. Additional-view videoinformation according to an exemplary embodiment may be set as followswith reference to Table 12.

TABLE 12 additional_view_image_size Description 0x00 horizontal half0x01 vertical half 0x02 quarter size 0x03~0x0f reserved

When the value of parameter ‘additional_view_image_size’ is 0x00, itrepresents a method of halving the image size of the additional-viewvideo information in a horizontal direction. This method is anadditional-view image reducing method that can be efficiently used in 3Ddisplay devices for halving input video data in a horizontal directionand reproducing a result of the halving, including parallax barrierdisplay devices.

When the value of parameter ‘additional_view_image_size’ is 0x01, itrepresents a method of halving the image size of the additional-viewvideo information in a vertical direction. This additional-view imagereducing method may be efficiently used in display devices for halvingthe resolution of an image in a vertical direction and reproducing aresult of the halving, including display devices that performreproduction while changing a polarization angle in units of horizontallines of a 3D video.

When the value of parameter ‘additional_view_image_size’ is 0x02, itrepresents a method of reducing the image size by half in a verticaldirection and in a horizontal direction, respectively, and thus reducingthe image size to ¼ overall. This additional-view image reducing methodmay be used in depth information or disparity information rather thanvideo data in order to reduce loss and increase compression efficiency.

Parameter ‘scaling_method’ represents down-scaling method informationthat represents a method of down-scaling the left-view image and theright-view image of a 3D composite format image. A 3D composite formatscales down the video data of a frame for each of a plurality of viewsso that a single frame includes data pieces for the plurality of views.The down-scaling may be performed using any of various down-scalingmethods. However, since the down-scaling method is performed in apre-processing process occurring before compression, if the image sizeis restored according to an up-scaling method not corresponding to thedown-scaling method during video decoding, artifacts may be generated ona restored image. An example where artifacts may be generated duringimage down-scaling and image restoration will now be described withreference to FIG. 13.

FIG. 13 illustrates an example in which down-scaling method informationfor 3D composite formats is used, according to an exemplary embodiment.

For example, only even-numbered lines 1314 and 1318 from among lines1312, 1314, 1316, and 1318 of an original image 1310 are sub-sampled andarranged in an upper region 1320 of a top-and-bottom format image. Inother words, lines 1322 and 1324 of the upper region 1320 of thetop-and-bottom format image are the same as the even-numbered lines 1314and 1318 of the original image 1310.

However, if the lines 1322 and 1324 of the top-and-bottom format imageare arranged at locations of odd-numbered lines 1332 and 1336 of arestored image 1330, and not at locations of even-numbered lines 1334and 1338 of the restored image 1330, during an up-scaling operationperformed during image decoding, one-pixel mismatch in a verticaldirection may occur in all pixels of the restored image 1330. If aleft-view image and a right-view image are each mismatched in units ofone pixel, mismatch in units of a maximum of two pixels may occur in a3D video.

Thus, to achieve accurate restoration of a 3D video, the digitalbroadcasting stream transmitting apparatus 100 of FIG. 1 and the digitalbroadcasting stream receiving apparatus 200 of FIG. 2 may transmit andreceive the down-scaling method information for 3D composite formats.Down-scaling method information according to an exemplary embodiment maybe set as parameter ‘scaling_method’ as in Table 13.

TABLE 13 scaling_method Description 0x00 sampling method 0x01 averagingmethod 0x02~0x03 Reserved

When the value of parameter ‘scaling_method’ is 0x00, a current 3Dcomposite format may include left-view image information and right-viewimage information that have been down-scaled according to a samplingmethod in which one of every two consecutive lines is selected andextracted.

When the value of parameter ‘scaling_method’ is 0x01, the current 3Dcomposite format may include left-view image information and right-viewimage information that have been down-scaled with respect to twoconsecutive lines of each of an original left-view image and an originalright-view image with a single line by replacing the two consecutivelines with a result of an arithmetic operation performed thereon. Arepresentative method of forming a 3D composite format with adown-scaled left-view image and a down-scaled right-view image may be anaveraging method in which an average value between pixels of twoconsecutive lines is determined as a pixel value of a single line.

Parameter ‘scaling_order’ represents down-scaling sampling orderinformation that represents a sampling order of a 3D composite formatimage down-scaled according to a sampling method. When the value ofparameter ‘scaling_method’ representing the down-scaling sampling orderinformation is 0x00, it represents which lines from among odd-numberedand even-numbered lines of a left-view image and a right-view image aresampled to constitute a 3D composite format. An example of usingdown-scaling sampling order information according to an exemplaryembodiment is shown in Table 14.

TABLE 14 scaling_order left view right view 0x00 odd line even line 0x01even line odd line 0x02 odd line odd line 0x03 even line even line

When the value of parameter ‘scaling_order’ is 0x00, an odd-numberedline of a left-view image is sampled and an even-numbered line of aright-view image is sampled to construct a 3D composite format image.Similarly, when the value of parameter ‘scaling_order’ is 0x01, aneven-numbered line of a left-view image is sampled and an odd-numberedline of a right-view image is sampled to construct a 3D composite formatimage. When the value of parameter ‘scaling_order’ is 0x02, anodd-numbered line of a left-view image and an odd-numbered line of aright-view image are sampled to construct a 3D composite format image.When the value of parameter ‘scaling_order’ is 0x03, an even-numberedline of a left-view image and an even numbered line of a right-viewimage are sampled to construct a 3D composite format image.

Hereinafter, parameter ‘Is_Main’, parameter ‘picture_display_order’, andparameter ‘view_info’ are set when the video property information of thecurrent video stream represents 3D video data, that is, when parameter‘3d_video_property’ is ‘Left Video’ or ‘Right Video’.

Parameter ‘Is_Main’ represents base-view indicator information thatrepresents whether the current video stream is a base-view video stream.For example, when parameter ‘3d_video_property’ representing the videoproperty information of the current video stream is ‘Left video’,parameter ‘Is_Main’ may be set as in Table 15.

TABLE 15 Is_Main Description 0x0 Sub Video 0x1 Main Video

That is, when the value of parameter ‘Is_Main’ is 0, left-view videodata is set to be a sub video. When the value of parameter ‘Is_Main’ is1, the left-view video data is set to be a main video.

Parameter ‘picture_display_order’ represents display order informationthat represents an order in which ESs of left-view and right-view aredisplayed.

Parameter ‘view_info’ represents 3D-video view-related information inwhich, if a current video stream is a 3D video, view information is setdifferently for children and adults. In consideration of the fact thatchildren and adults are different in binocular variances, view-relatedinformation such as depth and disparity may be set differently forchildren and adults. For example, an image for adults is an image havinga relatively large binocular parallax, and an image for children is animage having a relatively small binocular parallax. Due to the use ofparameter ‘view_info’, images for adults may be distinguished fromimages for children, and also selective 3D reproduction may be performedaccording to the screen size of a 3D display device. Parameter‘view_info’ may be used so that if the screen size of a 3D displaydevice is relatively large, a 3D image having a relatively smallbinocular parallax is reproduced and if the screen size of a 3D displaydevice is relatively small, a 3D image having a relatively largebinocular parallax is reproduced. When 3D video contents aremanufactured in consideration of this case, a stereoscopic effect may beuniformly provided to viewers regardless of the size of a 3D display.

Parameter ‘view_index’ represents video index information that indicatesa current view from among multiple views of a current video stream ifthe current video stream is in regards to one of a plurality of 2Dvideos each including the multiple views. In other words, if parameter‘3d_video_property’ representing the video property information of thecurrent video stream is ‘2D_Multi’, parameter ‘view_index’ may be set.Parameter ‘2D_Multi’ may be used when a service including a plurality of2D videos is received. In this case, parameter ‘view_index’ may be usedto distinguish 2D moving pictures from one another.

Parameter ‘es_icon_indicator’ represents a 3D video service notificationindicator that indicates provision of 3D service-related icons from acontents provider. Indication of notification of a 3D video service maybe inserted into contents through the 3D video service notificationindicator without overlapping with a settop box or a TV.

The digital broadcasting stream transmitting apparatus 100 of FIG. 1 andthe digital broadcasting stream receiving apparatus 200 of FIG. 2 maytransmit and receive information associated with conversion of a 2D or3D reproduction mode in the current video stream. Hereinafter, areproduction mode transition indicator, reproduction mode conversiontime information, or the like may be set as the information associatedwith reproduction mode conversion.

Parameter ‘transition_indicator’ includes a reproduction mode transitionindicator that indicates whether a 2D/3D video reproduction modedifferent from that set in current PMT information is set in PMTinformation following the current PMT information. The reproduction modetransition indicator indicates that, when different pieces ofreproduction mode information are set in the following PMT informationand the current PMT information, a reproduction mode transition hasoccurred.

Parameter ‘transition_time_stamp’ represents reproduction modetransition time information that represents, in units of PresentationTime Stamps (PTSs), the time during which reproduction mode transitionoccurs. The reproduction mode transition time information may be set asan absolute period of time or as a relative period time starting from apredetermined reference point of time.

Parameter ‘transition_message’ includes a variety of message informationsuch as a text, an image, an audio, and the like for notifying viewersof a reproduction mode transition. For example, parameter‘transition_message’ includes size information and message informationof a reproduction mode transition message, and a reproduction modetransition message may be represented in an 8-bit character string byusing a for statement that is repeated by a number of timescorresponding to the value of a message size parameter.

The 3D video stream descriptor according to an exemplary embodiment isnot limited to the syntax shown in Table 7 and may be suitably changedwhen a 3D video is expanded into a multi-view image or used forpredetermined purposes.

The TS generation unit 120 of the digital broadcasting streamtransmitting apparatus 100 of FIG. 1 may insert a multi-view videostream descriptor for accurate distinction among multi-view videostreams into the PMT information for the current video stream. The ESextraction unit 220 of the digital broadcasting stream receivingapparatus 200 of FIG. 2 may extract the multi-view video streamdescriptor from the PMT information for the current video stream. Themulti-view video stream descriptor includes additional information usedby the reproduction unit 230 of the digital broadcasting streamreceiving apparatus 200 of FIG. 2 to accurately restore and reproducemulti-view video streams.

A multi-view video stream descriptor according to an exemplaryembodiment may be set as in Table 16.

TABLE 16 Syntax multiview_video_stream_descriptor( ){   descriptor_tag  descriptor_length   number_of_views   mv_numbering }

Parameter ‘number_of_views’ represents information about the number ofviews of a multi-view video stream.

Parameter ‘mv_numbering’ represents video index information of themulti-view video stream. For example, the value of parameter‘mv_numbering’ may be set to start at 0 for a leftmost view video streamand increase by 1 with each video stream to the right of the leftmostview video stream. The value of parameter ‘mv_numbering’ of the leftmostview video stream may be set to be 0, and the value of parameter‘mv_numbering’ of the leftmost view video stream may be set to be avalue obtained by subtracting 1 from the value of parameter‘number_of_views’.

A location of a base-view video stream in a multi-view video stream maybe predicted from parameter ‘linking_priority’ of parameter‘linking_descriptor’. The value of parameter ‘linking_priority’ of thebase-view video stream may be set to be 10, and the values of parameter‘linking_priority’ of the other-view video streams may be all set to be11.

By referring to the aforementioned link descriptor and the 3D videostream descriptor, the digital broadcasting stream transmittingapparatus 100 of FIG. 1 may set a partial link descriptor and a 3D videostream descriptor of a left-view video stream corresponding to thebase-view video stream as in Table 17 and set a partial link descriptorand a 3D video stream descriptor of a right-view video streamcorresponding to an additional-view video stream as in Table 18.

TABLE 17 Syntax Value linking_priority 10 3d_video_property 0000linked_stream_coding_mode 000 full_image_size_indicator 1

TABLE 18 Syntax value linking_priority 11 3d_video_property 0001linked_stream_coding_mode 000 full_image_size_indicator 1

If the digital broadcasting stream receiving apparatus 200 of FIG. 2extracts a link descriptor and a 3D video stream descriptor for a firstvideo stream set as in Table 17, since link priority information for thefirst video stream is ‘linking_priority==10’ and 3D video propertyinformation for the first video stream is ‘3d_video_property==0000’, itmay be determined that the first video stream is a left-view videostream of a reference view having higher priority than the opponentvideo stream associated with the first video stream.

If the digital broadcasting stream receiving apparatus 200 of FIG. 2extracts a link descriptor and a 3D video stream descriptor for a secondvideo stream set as in Table 18, since link priority information for thesecond video stream is ‘linking_priority==11’ and 3D video propertyinformation for the second video stream is ‘3d_video_property==0001’, itmay be determined that the second video stream is a right-view videostream of an additional view having lower priority than the opponentvideo stream associated with second first video stream.

The digital broadcasting stream receiving apparatus 200 of FIG. 2 maydetermine that, as the values of parameter ‘linked_stream_coding_mode’for the first and second video streams are 000, the first and secondvideo streams have been encoded according to an encoding methodindependent from that used to encode the opponent video stream, and thatas the value of parameter ‘full_image_size_indicator’ is 1, the originalimage size is maintained.

FIGS. 14, 15, 16, 17, and 18 are schematic views of reproduction unitsof digital broadcasting stream receiving apparatuses according toexemplary embodiments. A method in which the reproduction unit 230 ofthe digital broadcasting stream receiving apparatus 200 of FIG. 2restores and reproduces 3D or 2D video data from a video stream will nowbe described with reference to FIGS. 14 through 18.

According to a first exemplary embodiment 1400 of the reproduction unit230, left-view video data 1415 and right-view video data 1425 may berestored by stream decoders 1410 and 1420, respectively. The left-viewvideo data 1415 and the right-view video data 1425 may be converted intoa 3D reproduction format that can be reproduced as a 3D video, by a 3Dformatter or renderer 1430. A signal of the 3D reproduction format maybe reproduced by a 3D display device 1440.

According to a second exemplary embodiment 1500 of the reproduction unit230, 2D video data 1515 and depth/disparity video 1525 may be restoredby stream decoders 1510 and 1520, respectively. The 2D video data 1515and the depth/disparity video 1525 may be converted into the 3Dreproduction format by a 3D renderer 1530. A signal of the 3Dreproduction format may be reproduced by a 3D display device 1540.

According to a third exemplary embodiment 1600 of the reproduction unit230, 2D video data 1615 and a 3D composite video 1625 may be restored bystream decoders 1610 and 1620, respectively. The 3D composite video 1625is converted into the 3D reproduction format by a 3D formatter 1630. The2D video data 1615 and a signal of the 3D reproduction format mayundergo a reproduction mode conversion process 1640 based on a userinput or an automatic reproduction mode conversion algorithm and thenmay be selectively reproduced by a 3D display device 1650.

According to a fourth exemplary embodiment 1700 of the reproduction unit230, main 2D video data 1715 and sub 2D video data 1725 may be restoredby stream decoders 1710 and 1720, respectively. The main 2D video data1715 and the sub 2D video data 1725 may undergo a video conversionprocess 1730 based on a user input or a main/sub video selectionalgorithm and then may be selectively reproduced by a 2D display device1740.

According to a fifth exemplary embodiment 1800 of the reproduction unit230, main 2D video data 1815 and sub 2D video data 1825 may be restoredby stream decoders 1810 and 1820. The main 2D video data 1815 and thesub 2D video data 1825 may be reproduced in a PIP mode by a 2D displaydevice 1830. In other words, the main 2D video data 1815 may bereproduced on a screen 1840 of the 2D display device 1830 to cover thescreen 1840 entirely, and the sub 2D video data 1825 may be reproducedon a partial screen 1850 of the 2D display device 1830.

A Main 2D video and a sub 2D video are not videos for achieving astereoscopic effect of 3D contents but may be videos of mutuallyassociated contents. For example, a 2D video of a main view may containcontents of a baseball game scene, and a 2D video of a sub view maycontain contents of additional information of a baseball game, such asstand scenes, analysis information of the pitching posture of a currentpitcher, batting average information of the current pitcher, and thelike.

In this case, the digital broadcasting stream transmitting apparatus 100of FIG. 1 may set and transmit link information and 3D video streaminformation for the main 2D video and the sub 2D video, and the digitalbroadcasting stream receiving apparatus 200 of FIG. 2 may restore themain 2D video and the sub 2D video linked with each other by using thelink information and the 3D video stream information and selectivelyreproduce the main 2D video and the sub 2D video or reproduce the samein the PIP mode. Accordingly, a user may watch a variety of informationabout a baseball game in a sub view while continuously watching thebaseball game in a main view.

The digital broadcasting stream transmitting apparatus 100 of FIG. 1transmit and the digital broadcasting stream receiving apparatus 200 ofFIG. 2 receive link information between mutually associated videostreams for a data stream that provides 3D video and 2D video, therebyrealizing a 3D digital video contents broadcasting system while securingcompatibility with digital broadcasting systems for 2D contentsservices.

The digital broadcasting stream transmitting apparatus 100 of FIG. 1 andthe digital broadcasting stream receiving apparatus 200 of FIG. 2provide 3D moving picture services which are not interrupted by time andplace, by providing 2D digital contents and 3D digital contents whilesecuring compatibility with media such as digital video discs (DVDs).

FIG. 19 is a flowchart of a digital broadcasting stream transmittingmethod capable of providing 3D video services, according to an exemplaryembodiment.

In operation 1910, a plurality of ESs for a plurality of pieces of videoinformation including at least one of information about a base-viewvideo of a 3D video, information about an additional-view video of the3D video, and a 2D video having a different view from that of the 3Dvideo are generated.

In operation 1920, link information between the plurality of pieces ofvideo information and the plurality of ESs are multiplexed to generateat least one TS.

In operation 1930, the at least one TS is transmitted via at least onechannel.

FIG. 20 is a flowchart of a digital broadcasting stream receiving methodcapable of providing 3D video services, according to an exemplaryembodiment.

In operation 2010, at least one TS is received via at least one channel.The at least one TS may include a plurality of pieces of videoinformation including at least one of information about a base-viewvideo of a 3D video, information about an additional-view video of the3D video, and a 2D video having a different view from that of the 3Dvideo.

In operation 2020, the at least one received TS is demultiplexed toextract linking information between pieces of video information and atleast one ES for the plurality of video information pieces from the TS.

In operation 2030, at least one of 3D video data and 2D video datarestored by decoding the extracted at least one ES is reproduced inconsideration of a link represented by the linking information.

The digital broadcasting stream transmitting method of FIG. 19 and thedigital broadcasting stream receiving method of FIG. 20 may be performedby computer program interactions, respectively. By doing this,operations of the digital broadcasting stream transmitting apparatus 100and the digital broadcasting stream receiving apparatus 200 that areperformed according to the exemplary embodiments described above withreference to FIGS. 1, 2, 5-12, and 14-18 may be implemented.

Exemplary embodiments can be written as computer programs and can beimplemented in general-use digital computers that execute the programsusing a computer readable recording medium. Examples of the computerreadable recording medium include magnetic storage media (e.g., ROM,floppy disks, hard disks, etc.) and optical recording media (e.g.,CD-ROMs, or DVDs). Moreover, one or more units of the apparatuses 100,200, 300, 400, 600, 800, 900, and 1000 can include a processor ormicroprocessor executing a computer program stored in acomputer-readable medium.

While exemplary embodiments have been particularly shown and describedabove, it will be understood by those of ordinary skill in the art thatvarious changes in form and details may be made therein withoutdeparting from the spirit and scope of the present inventive concept asdefined by the following claims.

1. A digital broadcasting stream transmitting method for providingthree-dimensional (3D) video services, the method comprising: generatinga plurality of elementary streams for a plurality of pieces of videoinformation comprising at least one of information about a base-viewvideo of a 3D video, information about an additional-view videocorresponding to the base-view video, and a two dimensional (2D) videohaving a view different from views of the 3D video; generating at leastone transport stream by multiplexing the generated plurality ofelementary streams with link information for identifying at least onepiece of video information linked with the plurality of pieces of videoinformation; and transmitting the generated at least one transportstream via at least one channel.
 2. The digital broadcasting streamtransmitting method of claim 1, wherein: the generating the at least onetransport stream comprises: multiplexing each of the generated pluralityof elementary streams individually to generate a plurality ofsingle-program transport streams; and multiplexing each of the generatedplurality of single-program transport streams individually to generate aplurality of multi-program transport streams; and the transmitting thegenerated at least one transport stream comprises transmitting thegenerated plurality of multi-program transport streams via differentchannels.
 3. The digital broadcasting stream transmitting method ofclaim 1, wherein the generating the at least one transport streamcomprises: multiplexing each of the generated plurality of elementarystreams individually to generate a plurality of single-program transportstreams; and multiplexing the generated plurality of single-programtransport streams to generate a single multi-program transport stream;and the transmitting the generated at least one transport streamcomprises transmitting the generated single multi-program transportstream via a single channel.
 4. The digital broadcasting streamtransmitting method of claim 1, wherein the generating the at least onetransport stream comprises: multiplexing the generated plurality ofelementary streams to generate a single single-program transport stream;and multiplexing the generated single single-program transport stream togenerate a single multi-program transport stream; and the transmittingthe generated at least one transport stream comprises transmitting thegenerated single multi-program transport stream via a single channel. 5.The digital broadcasting stream transmitting method of claim 1, wherein:the generating the at least one transport stream comprises: multiplexingeach base-view ES for at least one base-view video, from among thegenerated plurality of ESs, to generate at least one base-viewsingle-program transport stream for the at least one base-view video,and multiplexing each of the generated at least one base-viewsingle-program transport stream to generate at least one base-viewmulti-program transport stream for the at least one base-view video; andmultiplexing an additional-view elementary stream for information aboutat least one additional-view video corresponding to the at least onebase-view video, from among the generated plurality of elementarystreams, to generate a single additional-view single-program transportstream for the at least one additional-view video, and multiplexing thegenerated single additional-view single-program transport stream togenerate a single additional-view multi-program transport stream for theat least one additional-view video; and the transmitting the generatedat least one transport stream comprises transmitting the generated atleast one base-view multi-program transport stream and the generatedsingle additional-view multi-program transport stream via differentchannels.
 6. The digital broadcasting stream transmitting method ofclaim 2, wherein the at least one multi-program transport stream istransmitted via channels based on individual types of transmissionnetwork systems.
 7. The digital broadcasting stream transmitting methodof claim 1, wherein the linking information comprises a link identifierthat represents whether mutually linked pieces of video informationexist in the plurality of pieces of video information included in thegenerated at least one transport stream.
 8. The digital broadcastingstream transmitting method of claim 7, wherein: the generating the atleast one transport stream comprises inserting the link identifier intoa program association table for the at least one TS; and the linkidentifier represents information that indicates whether program maptables for the mutually linked pieces of video information identified bythe program association table are linked with each other.
 9. The digitalbroadcasting stream transmitting method of claim 1, wherein the linkinginformation comprises a link descriptor that includes information abouta link between mutually linked pieces of video information from amongthe plurality of pieces of video information included in the at leastone transport stream.
 10. The digital broadcasting stream transmittingmethod of claim 9, wherein the generating the at least one transportstream comprises inserting the link descriptor into a program map tablefor the generated plurality of elementary streams for the mutuallylinked pieces of video information.
 11. The digital broadcasting streamtransmitting method of claim 10, wherein the link descriptor comprisesat least one of linking priority information that indicates existence orabsence of a link between pieces of video information and prioritybetween associated pieces of video information, same-kind transmissionnetwork method information that indicates whether the associated videoinformation pieces are transmitted using a single transmission networkmethod, same channel information that indicates whether the associatedpieces of video information are transmitted via a single channel, samesingle-program transport stream information that represents whether theassociated pieces of video information exist within a singlesingle-program transport stream, same view information that representswhether the associated pieces of video information have a same view, andlinked video stream packet identifier information that indicates apacket identifier of a video stream which includes a corresponding oneamong the associated pieces of video information.
 12. The digitalbroadcasting stream transmitting method of claim 1, wherein thegenerating the at least one transport stream comprises inserting a 3Dvideo stream descriptor comprising additional information used toreproduce current video information of a current transport stream, intoa program map table for the current video information.
 13. The digitalbroadcasting stream transmitting method of claim 12, wherein the 3Dvideo stream descriptor comprises at least one of 3D video propertyinformation that represents video properties of the current videoinformation when the 3D video is constructed, linked video encodingmethod information that represents a compressive encoding method for theassociated pieces of video information, and size indicator informationthat indicates whether the current video information is transmitted atan original size.
 14. The digital broadcasting stream transmittingmethod of claim 13, wherein the 3D video stream descriptor furthercomprises at least one of 3D composite format information thatrepresents a 3D composite format obtained and transmitted by composingimages corresponding to the base-view video and the additional-viewvideo, format arrangement sequence information that represents asequence in which a base-view image and an additional-view image of the3D composite format are arranged, additional-view image size informationthat represents a rate at which the additional-view video image isenlarged or reduced from an original image size, down-scaling methodinformation that represents a method of down-scaling the base-view imageand the additional-view image of the 3D composite format, anddown-scaling sampling order information that represents a sampling orderto obtain a down-scaled image of the 3D composite format obtainedaccording to a sampling method.
 15. The digital broadcasting streamtransmitting method of claim 12, wherein the 3D video stream descriptorcomprises 3D-video view-related information in which view information isset differently for children and adults.
 16. The digital broadcastingstream transmitting method of claim 12, wherein the 3D video streamdescriptor comprises at least one of a reproduction mode transitionindicator that indicates whether a reproduction mode transition occursby including a video stream in a reproduction mode different from areproduction mode of a video stream of a current program map table fromamong a 2D video reproduction mode and a 3D video reproduction mode, ina program map table following the current program map table,reproduction mode transition time information that represents a timeduring which the reproduction mode transition occurs, and messageinformation related with the reproduction mode transition.
 17. Thedigital broadcasting stream transmitting method of claim 1, wherein: thegenerating the at least one transport stream comprises inserting amulti-view video stream descriptor representing a relationship betweenpieces of multi-view video information from among the plurality ofpieces of video information into a program map table for the pieces ofmulti-view video information; and the multi-view video stream descriptorcomprises information about a number of views of a multi-view image andindex information of the multi-view image.
 18. A digital broadcastingstream receiving method for providing three-dimensional (3D) videoservices, the method comprising: receiving at least one transport streamfor a plurality of pieces of video information comprising at least oneof information about a base-view video of a 3D video, information aboutan additional-view video of the 3D video, and a two-dimensional (2D)video having a different view from views of the 3D video, via at leastone channel; demultiplexing the received at least one transport streamto extract, from the at least one transport stream, linking informationfor identifying at least one piece of video information linked with theplurality of pieces of video information, and at least one elementarystream for the plurality of pieces of video information; and decodingthe extracted at least one elementary stream to reproduce at least oneof the 3D video and the 2D video restored by the decoding based on theextracted linking information.
 19. The digital broadcasting streamreceiving method of claim 18, wherein: the receiving comprises receivingat least one multi-program transport stream by decoding each of the atleast one channel and receiving a single multi-program transport streamfrom each of the at least one channel; and the extracting comprises:extracting at least one single-program transport stream bydemultiplexing each of the received at least one multi-program transportstream and extracting a single single-program transport stream from eachof the demultiplexed at least one multi-program transport stream; andextracting the at least one elementary stream by demultiplexing each ofthe extracted at least one single-program transport stream andextracting a single elementary stream from each of the demultiplexed atlast one single-program transport stream.
 20. The digital broadcastingstream receiving method of claim 18, wherein: the receiving comprisesreceiving a multi-program transport stream via a channel from among theat least one channel by decoding the channel; and the extractingcomprises: extracting at least one single-program transport stream bydemultiplexing the received multi-program transport stream; andextracting the at least one elementary stream by demultiplexing each ofthe extracted at least one single-program transport stream andextracting a single elementary stream from each of the demultiplexed atleast one single-program transport stream.
 21. The digital broadcastingstream receiving method of claim 18, wherein: the receiving comprisesreceiving a multi-program transport stream via a channel from among theat least one channel by decoding the channel; and the extractingcomprises: extracting a single-program transport stream bydemultiplexing the received multi-program transport stream; andextracting the at least one elementary stream by demultiplexing theextracted single-program transport stream.
 22. The digital broadcastingstream receiving method of claim 18, wherein: the receiving comprisesreceiving at least one base-view multi-program transport stream for abase-view video and a single additional-view multi-program transportstream for an additional-view video by decoding each of the at least onechannel and receiving a single multi-program transport stream, fromamong the at least one base-view multi-program transport stream and thesingle additional-view multi-program transport stream, via each of theat least one channel; and the extracting comprises: extracting at leastone base-view single-program transport stream from the received at leastone base-view multi-program transport stream by demultiplexing each ofthe received at least one base-view multi-program transport stream intoa single single-program transport stream, and extracting at least onebase-view elementary stream from the extracted at least one base-viewsingle-program transport stream by demultiplexing each of the extractedat least one base-view single-program transport stream into onebase-view elementary stream; and extracting at least one additional-viewsingle-program transport stream from the received single additional-viewmulti-program transport stream, and extracting at least oneadditional-view elementary stream from the extracted at least oneadditional-view single-program transport stream by demultiplexing eachof the extracted at least one additional-view single-program transportstream into one additional-view elementary stream.
 23. The digitalbroadcasting stream receiving method of claim 19, wherein the receivingcomprises receiving the at least one multi-program transport stream viachannels based on individual types of transmission network systems. 24.The digital broadcasting stream receiving method of claim 18, whereinthe linking information comprises a link identifier that representswhether mutually linked pieces of video information exist in theplurality of pieces of video information included in the received atleast one TS.
 25. The digital broadcasting stream receiving method ofclaim 24, wherein: the extracting comprises extracting the linkidentifier from a program association table for the at least one TS; andthe link identifier represents information that indicates whetherprogram map tables for the mutually linked pieces of video informationidentified by the program association table are linked with each other.26. The digital broadcasting stream receiving method of claim 18,wherein the linking information comprises a link descriptor thatincludes information about a link between mutually linked pieces ofvideo information from among the plurality of pieces of videoinformation included in the at least one TS.
 27. The digitalbroadcasting stream receiving method of claim 26, wherein the extractingcomprises extracting the link descriptor from a program map table forthe at least one elementary stream for the mutually linked pieces ofvideo information.
 28. The digital broadcasting stream receiving methodof claim 26, wherein the link descriptor comprises at least one oflinking priority information that indicates existence or absence of alink between pieces of video information and priority between associatedpieces of video information, same-kind transmission network methodinformation that indicates whether the associated video informationpieces are transmitted using a single transmission network method, samechannel information that indicates whether the associated pieces ofvideo information are transmitted via a single channel, samesingle-program transport stream information that represents whether theassociated pieces of video information exist within a singlesingle-program transport stream, same view information that representswhether the associated pieces of video information have a same view, andlinked video stream packet identifier information that indicates apacket identifier of a video stream which includes a corresponding oneamong the associated pieces of video information.
 29. The digitalbroadcasting stream receiving method of claim 18, wherein the extractingcomprises extracting a 3D video stream descriptor comprising additionalinformation used to reproduce current video information of a current TS,from a program map table for the current video information.
 30. Thedigital broadcasting stream receiving method of claim 29, wherein the 3Dvideo stream descriptor comprises at least one of 3D video propertyinformation that represents video properties of the current videoinformation when the 3D video is constructed, linked video encodingmethod information that represents a compressive encoding method for theassociated pieces of video information, and size indicator informationthat indicates whether the current video information is transmitted atan original size.
 31. The digital broadcasting stream receiving methodof claim 29, wherein the 3D video stream descriptor comprises at leastof 3D composite format information that represents a 3D composite formatobtained and transmitted by composing images corresponding to thebase-view video and the additional-view video, format arrangementsequence information that represents a sequence in which a base-viewimage and an additional-view image of the 3D composite format arearranged, additional-view image size information that represents a rateat which the additional-view video image is enlarged or reduced from anoriginal image size, down-scaling method information that represents amethod of down-scaling the base-view image and the additional-view imageof the 3D composite format, and down-scaling sampling order informationthat represents a sampling order to obtain a down-scaled image of the 3Dcomposite format obtained according to a sampling method.
 32. Thedigital broadcasting stream receiving method of claim 29, wherein the 3Dvideo stream descriptor comprises 3D-video view-related information inwhich view information is set differently for children and adults. 33.The digital broadcasting stream receiving method of claim 29, whereinthe 3D video stream descriptor comprises at least one of a reproductionmode transition indicator that indicates whether a reproduction modetransition occurs by including a video stream in a reproduction modedifferent from a reproduction mode of a video stream of a currentprogram map table from among a 2D video reproduction mode and a 3D videoreproduction mode, in a program map table following the current programmap table, reproduction mode transition time information that representsa time during which the reproduction mode transition occurs, and messageinformation related with the reproduction mode transition.
 34. Thedigital broadcasting stream receiving method of claim 18, wherein: theextracting comprises extracting a multi-view video stream descriptorrepresenting a relationship between pieces of multi-view videoinformation from among the plurality of pieces of video information froma program map table for the pieces of multi-view video information; andthe multi-view video stream descriptor comprises information about anumber of views of a multi-view image and index information of themulti-view image.
 35. The digital broadcasting stream receiving methodof claim 18, wherein the decoding comprises: restoring and extractingbase-view video data and additional-view video data of the 3D video fromthe extracted at least one elementary stream; and converting theextracted base-view video data and the extracted additional-view videodata corresponding to each other based on the linking information into a3D reproduction format that is reproducible by a 3D display device, andreproducing the 3D reproduction format.
 36. The digital broadcastingstream receiving method of claim 18, wherein the decoding comprises:restoring and extracting base-view 2D video data for the 3D video and atleast one of depth information and disparity information foradditional-view 2D video data from the extracted at least one elementarystream; converting the base-view video data and the at least one of thedepth information and the disparity information corresponding tobase-view video data based on the linking information into base-viewvideo data and additional-view video data that; and converting thebase-view video data and the additional-view video data into a 3Dreproduction format that is reproducible by a 3D display device, andreproducing the 3D reproduction format.
 37. The digital broadcastingstream receiving method of claim 18, wherein the decoding comprises:restoring and extracting 3D video data of a 3D composite format and 2Dvideo data from the extracted at least one elementary stream,respectively; converting the 3D video data of the 3D composite formatinto base-view video data and additional-view video data that isreproducible by a 3D display device; and selectively reproducing thebase-view video data, the additional-view video data, and the 2D videodata corresponding to each other based on the linking information. 38.The digital broadcasting stream receiving method of claim 18, whereinthe decoding comprises: restoring and extracting mutually associatedpieces of 2D video data from the extracted at least one elementarystream, respectively; and selectively and independently reproducingpieces of 2D video data corresponding to each other based on the linkinginformation.
 39. The digital broadcasting stream receiving method ofclaim 18, wherein the decoding comprises: restoring and extractingmutually associated pieces of 2D video data from the extracted at leastone elementary stream, respectively; and selectively reproducing piecesof 2D video data corresponding to each other based on the linkinginformation in a Picture-in-Picture mode.
 40. A computer-readablerecording medium having recorded thereon a program for the digitalbroadcasting stream transmitting method of claim
 1. 41. Acomputer-readable recording medium having recorded thereon a program forthe digital broadcasting stream receiving method of claim
 18. 42. Adigital broadcasting stream transmitting apparatus for providingthree-dimensional (3D) video services, the apparatus comprising: anelementary stream generation unit which generates a plurality ofelementary streams for a plurality of pieces of video informationcomprising at least one of information about a base-view video of a 3Dvideo, information about an additional-view video corresponding to thebase-view video, and a two-dimensional (2D) video having a differentview from views of the 3D video; a transport stream generation unitwhich generates at least one transport stream by multiplexing thegenerated plurality of elementary streams with link information foridentifying at least one piece of video information linked with theplurality of pieces of video information; and a transmission unit whichtransmits the generated at least one transport stream via at least onechannel.
 43. A digital broadcasting stream receiving apparatus forproviding three-dimensional (3D) video services, the apparatuscomprising: a transport stream receiving unit which receives at leastone transport stream for a plurality of pieces of video informationcomprising at least one of information about a base-view video of a 3Dvideo, information about an additional-view video of the 3D video, and atwo-dimensional (2D) video having a different view from views of the 3Dvideo, via at least one channel; an elementary stream extraction unitwhich demultiplexes the received at least one transport stream toextract, from the at least one transport stream, linking information foridentifying at least one piece of video information linked with theplurality of pieces of video information and at least one elementarystream for the plurality of pieces of video information; and areproduction unit which reproduces at least one of the 3D video data and2D video data restored by decoding the extracted at least one elementarystream based on a link represented by the linking information.